A method and system are provided for delivering content items to online users. The content items are to be displayed on user operated devices in response to a specified query. Subsets of items are generated from a set of content items responsive to the specified query. The subsets are selected to generally satisfy delivery requirements associated with each item. A different one of the subsets is delivered to each user making the query.