Been too long for me being south of Commissioner St to comment on those tracks and leave it to others.
The last section of tracks still in place on the Lake Shore that I saw was the centre section back in the spring and been on my do list to look at. There were no ties or rail on Villers St back in Aug with the section up to the Lake Shore dug up as well.
The only place I saw tank cars going to or anything for the waterfront area was the CanRoof plant last year. The yard was haft the size then and empty
Giving where Toronto heading for the waterfront, rail doesn't fit in that plan nor who would want a line to be at x location. Even Redpath moved from rail to trucks as it was screwing up the east LRT extension back in 2000's, but tracks were gone after that timeframe