A measurable means to evaluate a given relevancy verification process to a
human decision process is provided. For example, a cognitive concept
relationship (CCR) system can be utilized to provide a relevancy
verification evaluation that is independent of the relevancy quality of
the test data employed to train the relevancy verification algorithm
under test. This provides a means to evaluate relevancy verification of,
for example, keyword/item pairs for any number of business applications
with different relevance standards and/or changes in relevance standards
over time, without the need to manually re-label the test data and/or
re-measure the algorithmic relevancy.