Your right about the street Glide, I rode a friends and it's like riding and turning a much smaller bike. I'm not crazy about the Street Glide though......
What you get depends on how you ride, and if someone is on the back. My wife and I are planning on doing some travelling on our next bike, thats why I'm going with the Ultra Classic. Plenty of storage space, and with a luggage rack on the back, you can put a good sized bag on it. Plus, its confortable for longer rides and the radio + CD player will be useful.
I actually wanted to keep my Fatboy for riding around town, but right now finances wouldn't allow it and I had to sell it.