An integrated method for both super-resolution and multi-frame demosaicing
includes an image fusion followed by simultaneous deblurring and
interpolation. For the case of color super-resolution, the first step
involves application of recursive image fusion separately on the three
different color layers. The second step is based on minimizing a maximum
a posteriori (MAP) cost function. In one embodiment, the MAP cost
function is composed of several terms: a data fidelity penalty term that
penalizes dissimilarity between the raw data and the super-resolved
estimate, a luminance penalty term that favors sharp edges in the
luminance component of the image, a chrominance penalty term that favors
low spatial frequency changes in the chrominance component of the image,
and an orientation penalty term that favors similar edge orientations
across the color channels. The method is also applicable to color
super-resolution (without demosaicing), where the low-quality input
images are already demosaiced. In addition, for translational motion, the
method may be used in a very fast image fusion algorithm to facilitate
the implementation of dynamic, multi-input/multi-output color
super-resolution/demosaicing.