Eh, I wouldn't pity him too much. He hits me up for a one night stand every time he's in town. The only way I got him to stop directly asking was by telling him I had a huge bodybuilder lover who's very jealous of me. ;-)
So now he just asks me how things are with the lover, and if I'm still happy with him. All I have to say is "Of course! I'm not married to him!"
I can't help but laugh at him.