A computer-implemented method determines whether to apply a given paraphrase alternation pattern to an input string. The method includes generating a context model and applying the context model to determine whether the given paraphrase alternation pattern can be applied to the input string so as to preserve meaning.