I would count those 17 minutes walking time as your daily exercise and if it gets too cold, take the bus or Uber, not a big deal. For Sugar Wharf, it will be connected through PATH and before that, access CIBC Square's PATH or RBC WaterPark Place's PATH.