Working-age Canadians, those aged 25 to 64, recorded the sharpest drop in time spent with friends over a 30-year period.