After Byers retired from newspaper publishing, in 1883 he and his wife built themselves a mansion at what is now the corner of Bannock Street and West Thirteenth Avenue in Denver.