A system automatically monitors playing and wagering of a game. A card deck reader automatically reads a symbol identifying a rank and suit from each card in a deck of cards. A chip tray reader automatically images the contents of a chip tray, to periodically determine the number and value of chips in the chip tray, and to compare the change in contents of the chip tray to the outcome of game play for verifying that the proper amounts have been paid out and collected. A table monitor automatically images the activity occurring at a gaming table. Periodic comparison of the images identify wagering, as well as the appearance, removal and position of cards and other game objects on the gaming table. The system automatically determines the outcome of games, including losses and takes.