Deaths and major damage possible if ordnance is disrupted during building work, a report says.