Rebel, I wish you well. Hopefully, he'll be in an okay mood. Thing is though, he'll perhaps be asked where you are and why you did not come, and thus me may take that out on you in some way.
Actually, when I was spirtuallly 'strong' and I'd sometimes be there w/o my wife, I'd get asked, and it would bother me, and I actually did feel some hostility toward her. That's what that religion does. I never got angry w her or anything like that, but I was disappointed in her at times. In fact, it got worse when I was an elder because you then need to have the family in tow or else you're looked upon as maybe not having good control over your family.