To get into, say, Concordia, a Quebec student has to have their CEGEP (which is what I believe Genesis was referring to when he mentioned 2 years to get his "college" diploma).
Don't let the period of time put you off. I know that here in Ontario alot of Masters programmes will pay the student a certain stipend in exchange for teaching assistant duties. Not the greatest but at least you can totally focus on your studies then and do related work. I don't see why there wouldn't be the same thing in Quebec. For the BA: like Damselfly said.
I wasted 7 years of my life after getting my BSc at options that I thought were quick (like getting my teaching certificate). I find myself older (much older than you) and still not doing something I really love. So: Go for it.