I am a ubm (unbelieving mate) as well. My jw joined up years and years after we were married, our kids were lets say pre teen or so. My feeling is that the house/apartment is half mine and I will do as I please with it. If it bothers him that for a few weeks out of the year there are Christmas decorations & tree all throughout the house then that is a darn shame. He knew before we were married that I celebrated Christmas (as did he). Halloween? Easter? same thing except he usually steals the kids candy.
Why don't I follow the whole 'he is the head of the house routine'? in my mind that scripture is for Christians (and usually taken completely out of context but that is a different matter) and I do not consider jw's as Christian in any sense of the word therefore it has no meaning in our relationship.
As for jw litter-ature in the house, if he ever left jw rags lying around I would then leave the most vile jw crime/pedophile printout or apostate books out. Yes, it can cause ww3 for a short while but it has become an unspoken rule in our home, no literature for or against out in public view, ever. Your home should be a sanctuary for the two of you, a neutral zone if you will. Once the war is over and a truce is called it will calm down and can even be good again.
Think long and hard before you have children with him. Do lots of research about how difficult it is living with a jw. Research how many people have lost their children due to shunning and the blood issue before allowing your child to step foot in a kh. Personally I never allowed my kids anywhere near a kh because I knew about pedophile problem, shunning, spiritual and mental abuses. It was a long road and nobody will ever know how hard it was to keep them out or to what lengths I had to go through to keep them safe from this cult. Paid off in the end, my kids are well adjusted and have chosen a life of Christianity and still love their jw dad. (the kids also do not consider jw's as Christian because a jw has to go through the org and the gb to have any hope of a salvation whereas a Christian believes Jesus is the way to their salvation rather than mere men or an organization)
If you should have children with him let him know well in advance that if he attempts to indoctrinate the kids that you will be exposing them to other religions as well. You will also be educating them on what cults are and how they work. For every 'family' study he insists on you will also have a 'family' study of your choosing. Be it cults your own religion or the history of the wt. He needs to understand that you will fight for your children's very life, their physical, spiritual and emotional well being. He must never leave your child alone with any jw ever.
Sorry for the long ramble!
Get the Christmas tree, decorate it with your beloved ornaments. They are filled with memories that a jw simply cannot understand. Bake your cookies and fill your trays for friends and family with love. Being with a jw at Christmas you sometimes have to fake it a bit. Act joyful even when you don't feel it and soon you will find joy anyway, in spite of him. Merry Christmas!
Wishing you all the best.