A ceramic fiber composite comprises ceramic fibers bonded together by an at least partially ceramic binder formed from a nanoclay and at least one of a ceramic precursor material or a ceramic material. The present invention also concerns methods of forming ceramic fiber composites and burners containing them.