After a day of rain, we woke in Toronto to sunshine ready to visit some great houses and explore the city’s history. But late-night revellers and the sirens of a city weekend had meant for a …