A three-dimensional surgery simulation system is provided for generating a three-dimensional surgery simulation result of an anatomical part undergoing a simulated surgical procedure. The system includes a display unit, a three-dimensional visual imaging unit, a storage unit for storing a plurality of voxelized three-dimensional model image data sets, an input unit for controlling progress of the simulated surgical procedure, and a computing unit for computing the simulation result data in accordance with the voxelized three-dimensional model image data sets and under the control of the input unit, and for controlling the display unit to permit viewing of the surgery simulation result in three-dimensional form thereon by an operator wearing the visual imaging unit.