Whether or not he is baptized is irrelevant. If he believes that the jw are GOd's one true religion, he is a jw.
Now you need to be very careful of something. You are in danger of getting into a very difficult and painful situation. It is extremely common for a person to be raised a witness, they leave, hook up with someone, and then have a child. Having a child is a life changing experience. It causes you to want to be the person you always wanted to be but were to lazy. Now you want to do things right for your child. To someone who was or believes in the witnesses, that means going back to the KH.
If you have a child with him, he will very likely go back. In that case you can either decide to be a witness or an unbelieving spouse. Neither is very fun. As a witness you become a slave to a publishing company. Your entire life, destiny, and mind are turned over to them. Your jw husband, who will expect complete authority in your home, will try to make this your child's fate regardless of what you decide. As an unbelieving wife, your husband will have another wife, the wt. He will have another life outside his one with you. In that world you will always be inadequate because you will not to submit to God's will. Keeping the house, and your very active sex life will be all the use he has for you. All other needs will be taken care of by the wt.
Be very careful!!! Your life is in danger of taking a very tragic turn.
It is possible for him to stop beleiving in the jw as God's organization. He might even swear to you that is the case. The big acheivement is if he has no fear of not being a jw. Unless he is at that point, he is still a jw. If you can't get him to that point, I would not advise continuing any type of relationship with him.
Please be careful.