I don't think the building looks bad at all.
The issue with the Quarters is that it's currently worse than nothing. Unless a developer buys a large majority of it and master plans, the risk is huge for each development.
Who would want to take the risk when a gravel lot next door is going to...