Methods and apparatus for manipulating physical objects to produce sounds that are correlated with the feel of the objects being manipulated. Example devices called the PebbleBox, CrumbleBag and ScrubberGlove each use the manipulation of physical objects of arbitrary material as the basis for interacting with granular sound synthesis models. The sounds made by the objects as they are manipulated produce sound signal events that are detected and used to trigger and control the reproduction of stored sound samples in real time.