A method in a data processing system for providing a user of the system with a visual indication of a quality of one or more features of an on-screen help message (e.g., a usefulness, an importance, or a content level of the message). The method involves a generation of a graphical help interface (e.g., a graphical indicator of usefulness within a button)) to visually indicate the quality of the feature(s) of the on-screen help message, and a display of the graphical help interface in a display window associated with the on-screen help message. The method can further involve a customization to the user by the data processing system of one or more of the features of the on-screen help message that are visually indicated by the graphical user interface, and/or one or more additional features of the on-screen help message that are not visually indicated by the graphical user interface.