That's a possibility. But, requires much more frequent Stouffville line service to be practical for that kind of trips.
If the Stouffville trains run every 10 min or better, then sure, take LSE to Scarborough GO, then a Stouffville train north to Agincourt, then the Sheppard subway either west...