I applaud the ambition, but just to note, the City's minimum standards for accessibility require all sidewalks to be 2.1M wide at the minimum.
South of Dundas, though the City/TTC would doubtless object, you could easily run the LRT on a single track in that section, so as long as you had a two-track area right at Queen, and another north of Dundas where you could hold vehicles. This is done in many places around the world.
***
North of Dundas, I think the streetcar volumes are likely too high for any one-way operation.
***
In theory, I think you might choose to combine the pedestrian and cycling movements at Riverdale with a multi-use path of 4M. The problem there lies in that I don't see any logical way to extend that trail north of Danforth, so its a bit of dead-end.