I don't hate Robarts at all. It's one brutalist building I think has a lot of architectural merit, even if it is brutalist and not entirely urban.
Another one is the Ryerson Business Building. Sure, it's cheap, and the clash of materials between the retail, parking and university, but inside, it's not bad at all, and gave new life to Dundas, which badly needed it. I think it's OK, but not more than that.
Kerr Hall is another, though I would be fine with sacrificing portions of it (particularly the north side) as long as the idea of the Quad is maintained, but the south part of the building must stay, as should the murals in the central portion of the east block.
I also don't mind 2 Bloor West (CIBC), though I would have liked them to keep the old CIBC logo on it. The newer crappy swoosh really doesn't fit. HBC tower is okay, but the base needs to go.
77 Elm, Jorgenson and Sheraton Centre all get my golden wrecking ball award.