A speech information processing apparatus and method performs speech recognition. Speech is input, and feature parameters of the input speech are extracted. The feature parameters are recognized based on a segment pitch pattern model. The segment pitch pattern model may be obtained by modeling time change in a fundamental frequency of a phoneme belonging to a predetermined phonemic environment with a polynomial segment model. The segment pitch pattern model may also be obtained by modeling with at least one of a single mixed distribution and a multiple mixed distribution.