The stress of an affair can really take its toll on a person. Your spouse may be irritable around you for no apparent reason. Also, they may be overly happy for no reason as well. Because the relationship interactions can give them reason to respond emotionally and you will not be a participant of those interactions, their moods may seem out of whack.