Fibrous products containing a durable softening agent are disclosed. The softening agent generally comprises a polysiloxane containing a plurality of first functional groups. In order to improve the wet retention of the softening agent on cellulosic fibers, the softening agent is reacted with a retention agent. The retention agent generally comprises a cationic polymer having a second functional group. In one embodiment, for instance, the softening agent contains epoxy groups or anhydride groups, while the retention agent contains amine groups. Products that may be made according to the present invention include tissue products, wipes and other absorbent articles.