A CT detector capable of energy discrimination and direct conversion is disclosed. The detector includes multiple layers of semiconductor material with the layers having varying thicknesses. The detector is constructed to be segmented in the x-ray penetration direction so as to optimize count rate performance as well as avoid saturation. The detector also includes variable pixel pitch and a flexible binning of pixels to further enhance count rate performance.