A novel crystalline aluminophosphate and metalloaluminophosphate of the molecular sieve type, denominated SSZ-51, is prepared by hydrothermal synthesis from reactive sources of aluminum and phosphorus, fluorine and an organic templating agent, 4-dimethylaminopyridine. SSZ-51 is useful in catalysts for, e.g., hydrocarbon conversion reactions.