A technique for reducing a prototype database for use with handwriting recognizers. The prototype database is divided into multiple spaces and the effect on the error rate for removing each prototype is identified. All prototypes that contribute to the error rate are removed. If further prototype database reduction is desired, the technique identifies and removes one or more prototypes that have the least adverse effect on the error rate across all spaces. The technique continues removing prototypes in this manner until a desired prototype database size has been achieved.