Granite taken from the quarry was used to build the massive stone structure of the prison. In addition to the stone buildings, there were barrack buildings for the prisoners, constructed of wood and painted green with white trim around the windows.