The property on the site of the world's first savings bank is being restored by its new owners.