New neural networks for handwriting recognition may be build from existing neural networks. An existing neural network pre-trained for a starting language is chosen based on a desired target language. The neural network is modified so that it may be used to recognize characters of the target language, and the modified neural network is used in a handwriting recognizer for the target language. Modification includes copying one or more of the primary outputs of the existing neural network. An appropriate starting language may be chosen based on the desired target language. In addition, a "super network" may be provided that is a relatively large neural network configured to recognize characters from a number of different languages. One may customize a handwriting recognizer using such a super network by programming a mask to block outputs from the super network that are not necessary for the language desired to be recognized.