A radiation detector system having a heat pipe based cooling. The radiation detector system includes a radiation detector thermally coupled to a thermo electric cooler (TEC). The TEC cools down the radiation detector, whereby heat is generated by the TEC. A heat removal device dissipates the heat generated by the TEC to surrounding environment. A heat pipe has a first end thermally coupled to the TEC to receive the heat generated by the TEC, and a second end thermally coupled to the heat removal device. The heat pipe transfers the heat generated by the TEC from the first end to the second end to be removed by the heat removal device.