Speech segment data are encoded in accordance with their respective optimum encoding schemes. The speech segment data thus encoded are registered in a speech segment dictionary along with information specifying the encoding methods used in the encoding.