On-demand memory synchronization is provided for peripheral subsystems, including graphics systems, that include multiple co-processors operating in parallel. A region of master memory (memory associated with one of the peripheral co-processors) is copied, on demand, to a corresponding region of a different memory associated with another of the peripheral co-processors using a direct memory access operation that does not involve a CPU.