A computer implemented adaptive ensemble classifier is provided which includes: a plurality of classifiers; a decision structure that maps respective classifier combinations to respective classification decision results; and a plurality of respective sets of weights associated with respective classifier combinations.