A system, (i.e., a method, an apparatus, and computer-executable process steps), providing sharpness enhancement for coded video, in which a usefulness metric, calculates how much a pixel can be enhanced without increasing coding artifacts. The usefulness metric is separate from the enhancement algorithm such that a variety of different enhancement algorithms can be used in conjunction with the metric.