As an ex-elder myself , I know what you are going through.
My last couple of years as an elder when I was PIMO were painful - my ministry dropped virtually to zero , I was missing every meeting I possibly could , my public talk that I would give list dropped from 20 to about half a dozen that I felt comfortable to give. It is a very difficult transition & I was probably lucky that only one elder ( one of the uber self righteous JW types ) attacked me in elders meetings - the rest cut me some slack ( maybe because a few of them were slackers as well ). Eventually I just resigned - the whole situation was impossible to manage.
You are better just resigning as an elder on your own terms rather than being kicked out which will happen eventually - as an elder , you are expected to "take the lead" and it is very difficult to go through the motions when you know it is all false. Just my 2C,
Good luck with the marriage - once a wife loses intimacy , it is very difficult for you to rebuild that. Lots of marriages don't survive this process.