I moved to downtown Toronto in the early 90s. First it was in an apartment, and then it was in a townhouse condo.
By the mid 2000s, I was itching to leave. I wanted more room, and I had city fatigue as well. So yeah, I can totally relate.
In 2007 I moved to Scarborough, so still in the City of Toronto, not the true (905) 'burbs, but in a much quieter neighbourhood than anywhere downtown. Lots of space too, both for the house, and the lot. The first thing I told my real estate agent upon visiting the home before purchase was that for the first time in over a decade, I could actually hear birds singing outside. Yes, the difference was that dramatic. I was sold.
However, I made it a point to be no more than 30 minutes from either downtown or my workplace (which isn't downtown) by car. While downtown fatigues me, it's still a very nice place to visit. And I do visit often.
One thing I do note though is the traffic has gotten exponentially worse since I moved out of downtown, and it's only been 7 years since I've moved out of downtown. I guess it's all the traffic generated by all the new condo residents which weren't there when I lived downtown. (Yes, I drove when I lived downtown, because I didn't work downtown. I worked mid-town, but not on a subway line.) I've also noticed a lot more dog crap in parks and on sidewalks than they're used to be. Walking around Liberty Village in spring is a poo minefield. Totally disgusting.
Now that I have a kid, I definitely expect to stay here for the long haul, probably until we retire. However, I could see myself moving back into a condo after retirement, and the kids are out of the house. However, my wife, who also owned a condo downtown, wants to retire in this house.