((((((((((((((Odrade & Patter)))))))))))))
I know you've been struggling with this for a long time. There is a saying, it's rather crude but I think it settles things quite well; $#!+ or get off the pot!
You know if you don't go to the Memorial you will get a visit from the Elders asking why. IMHO I would let them in, listen to what they have to say give no answer to the question if you believe this is Jehovah's Organization. Calmly tell them to do what they feel they must do to protect the congregation, make it brief and ask them to leave. Then get on with your lives. Don't go to any Committee meetings. You will probably be DF'ed, but it will be done and you can move on.
I think as time goes by your families will have some interaction with you and Patter as long as it's not discussing spiritual things. I know that is the biggest concern for you and especially Patter, but really family never goes away entirely and you have the ball in your court to define how you will interact with them regardless of their crumby religious rules.
I think this would bring closure to you and Patter and you'll feel free to live your lives however you choose. It would be a big weight lifted off your shoulders.
Just my .02. I wish you both well in whatever you decide to do. It's great to have a new community of people who totally understand what you are going through and fill in when you've lost all your JW friends and family. Craig and I really value our friendship with you both and we are here anytime for you guys.
Hugs to you both!
Kate