A three-dimensional data processing technique is disclosed which makes natural CG reproduction of a real existing object possible with as small a data amount and as small a calculation amount as possible. Three-dimensional data processing method, program, and system acquire first data showing at least one of a surface shape or taken images of a real existing object and generate a bump map for creating a three-dimensional image of the object based on the first data.