A signal processing device, signal processing method, and program and recording medium which provide images and the like closer approximating real world signals. The signal processing device includes a processing region setting unit, a movement vector setting unit, a model generator, a normal equation generator, an activity detector, a weighting change unit, and a real world estimating unit.