I'm just worried for you as there seemed to be an emotional attachment to that guy, if it's strictly physical then any issues with having sex with you can be fixed with some "big toys"!
Fantasizing about Pierre while having sex with my boyfriend wasn't the deal breaker, I was deeply in love with my boyfriend and wanted to marry him and we can always find other ways to satisfy my needs in bed. In fact after he found out about Pierre and the insecure feelings started, I did everything I could to save the relationship: took us to couples counseling, sex therapy, bought a lot of lingerie and toys, role playing, etc. It seemed to be working until he bought me this HUGE dildo (bigger than Pierre) and saw the intense orgasms I had on it and how much I enjoyed it. He was shattered knowing he couldn't satisfy me like that himself even though I told him he was more important to me than those orgasms. Anyway things went downhill from there, and like I said the deal breaker was when the verbal abuse started and I didn't mention it before but he got so mad at me a few times he raised his arm but held back from hitting me, who knows if he would've one day. I knew at that point it was over, I was heartbroken and it took me a long time to get over him.
I'm rambling again but wanted you to know what might be ahead for you and your wife.
(and yes, I kept that dildo!!)