The Hartman Gymnasium was originally built into an existing U-shaped brick school building on the site. The school was demolished in the 1980s, but the line between brick and limestone on the gym's exterior shows where the school surrounded the east end of the building.