Systems, methods and media for managing an interactive streaming image system are disclosed. More particularly, hardware and/or software for generating, encoding, and transmitting image frames to an interactive client are disclosed. One embodiment provides a method for streaming images from a server to a client. Embodiments may include receiving from the client via a network client information and generating a new image frame based on the received client information. Embodiments may also include comparing the new image frame and a previous image frame and setting a new compression level based on the comparison between the new image frame and the previous image frame. Embodiments may also include encoding the new image frame based on the new compression level and transmitting the encoded new image frame and an indication of the new compression level to the client via the network.