Automatic detection of one or more segment boundaries in a video. An analysis window identifies a selected series of video frames of the video to analyze for segment boundaries. A property value is determined for each of the video frames in the series of video frames. A maximum difference of the differences of property values between adjacent frames is compared to a threshold median value and a ratio of the maximum difference to a determined mean of the differences of property values between adjacent frames is compared to an adaptive threshold value. A segment boundary is defined as a function of the comparisons.