Notverylikely,
Go then and let the chips fall where they may but remember you chose the course you did. No, not the adultery the choosing to leave when you knew it would cost you. And most likely big time. Please, don't come back crying, like so many here, that your kids will not visit you or will not speak to you. If you do not choose fading that is your right but remember they also have a right to do as you brought them up to do in their religion.
You and your wife raised little JWs. Just because you choose to leave it does not mean they will like little robots and follow you.