A speaker verification method consist of the following steps: (1) generating a code book (42) covering a number of speakers having a number of training utterances for each of the speakers; (2) receiving a number of test utterances (44) from a speaker; (3) comparing (46) each of the test utterances to each of the training utterances for the speaker to form a number of decisions, one decision for each of the number of test utterances; (4) weighting each of the decisions (48) to form a number of weighted decisions; and (5) combining (50) the plurality of weighted decisions to form a verification decision (52).