Techniques and tools for spatial extrapolation of pixel values in intraframe video encoding and/or decoding are described. For example, to predict the pixel values for a block of pixels, a video encoder or decoder uses spatial extrapolation from the pixel values of pixels in a causal neighborhood for the block of pixels.