That’s not an insult it’s a curse

Insult:

Your elevator doesn’t quite go all the way up.

You have all the creativity and emotional intelligence of a manager

One that I like that is also a curse rather than an insult is “I hope the rest of your day is as pleasant as you are”