A system and method for determining the quality of communications provided by a plurality of mobile telephones is provided. In one embodiment, the method may include receiving one or more telephone voice signals from each mobile telephone over a time period at one or both of a voice server or field voice quality test equipment. Concurrently with receiving telephone voice signals from each mobile telephone, receiving one or more reference device voice signals from a reference device substantially co-located with the mobile telephone. The method further includes determining the voice quality of the telephone voice signals and the reference device voice signals concurrently received with the telephone voice signals; determining one or more telephone statistical parameters based on the voice quality of the telephone voice signals; determining one or more reference device statistical parameters based on the voice quality of the reference device voice signals concurrently received with the telephone voice signals; and normalizing the one or more telephone statistical parameters of the telephone voice signals from each mobile telephone based on the one or more reference device statistical parameters of the reference device voice signals that were concurrently received with the telephone voice signals. The statistical parameters may include (1) an average the voice quality samples; (2) a standard deviation of the voice quality samples; (3) a mean of the voice quality samples; (4) a percentage of the voice quality samples above a threshold; and (5) a percentage of the voice quality samples below a threshold. The method may also include collecting radio parameter data during the test and comparing normalized statistical parameters of telephones tested in similar radio conditions.