相手の都合が悪い時に

when he or she is busy

when he or she is doing something

when he or she is occupied

when it is inconvenient for

※「都合が悪い」に《人 + is inconvenient》は不可。