I was in a similar situation.

My wife had more of that charm and sex appeal than my close friend's wife. His pleasantries were not as aggressive but evident.

My wife and I noticed that. She was pleased that others saw her sexy; I was happy that I married a hot girl.

Then, to my surprise, my friend complained to me that I did not complement his wife as much as he did do it to my wife. So I made a few nice comments on the next occasion.