I have a friend from Newfoundland and anothef from N.S. that said the exact same thing as you. He really didn't like Toronto because of it.
I have two friends, one from Brooklyn, New York and the other from Northern California, who both said that the people of Toronto were the kindest and warmest they've ever met. The guy from California was actually impressed that people came up to him to give him directions when they saw he was lost. I guess it's all about perspective
Both were overall very impressed with the city. My friend from Brooklyn is thinking about moving her family to Toronto because she feels that her and her family will have greater opportunity here. The other from California fell in love with this city and wants to move here once he's done school.