In general, the invention features genetically modified non-human mammals (e.g., bovines and other ungulates), and methods of making these mammals. In particular, the invention features transgenic ungulates having reduced levels of endogenous IgM heavy chain and/or prion protein.