I have been lucky when I look back at it. I have lived in Scarborough as a child, then Ajax for my teen years and early 20's, Downtown(well Downtown adjacent at King and Dufferin) and now back to Scarborough though in a different part. I have worked in Markham, Ajax, North York and Etobicoke, though now as a Realtor I find myself exploring more of the GTA and its surrounding areas.
There are parts I enjoy in all of them and parts I greatly disliked but I do have to say, The East End does feel more like home to me. As much as I am drawn to the lifestyle of living Downtown, I like having my own front door and not worrying about my parking situation.