I loved lots of things about living in small town Minnesota but hadn't realized what I missed about coastal city life until we moved back to Providence. Being closer to friends, the arts and culture, beaches, great food, etc. Easy access to a faster pace of life when we want it and a slow day fishing for blue crabs when we need it. We "managed" living in a small town OK but living in this city has probably rejuvenated our marriage.
Of course, I don't know what Toronto is like. There are cities where I'd never want to live and would choose small town in a second (NYC comes to mind). But you really got to break down your day, the things you like to do, and other commitments to see if a lengthy commute everyday is worthwhile.