The invention relates to a method for the automated analysis and appraisal of a mobile radio telephone system (1). Said method scans calls that are executed as part of a test phase, in accordance with internal and external system parameter values which flag error conditions (e.g. handover errors) or system performance deficiencies (e.g. poor voice quality during transmission). In a subsequent step, the parameters are evaluated in several modules (12.1-12.3) according to selectable grouping criteria, whereby for each module a multitude of relevant events or event sequences are examined and a module quality value (17.1-17.3) is determined with regard to a specific appraisal criterion. The system quality value (20) of the entire system is calculated as a weighted sum of the quality values from the individual modules and can be displayed graphically as a comparison of all groups, with regard to the chosen grouping criterion.