The present invention discloses a method of summarizing a sports video. The method includes the following steps: selecting at least a summarization style, wherein the summarization style is defined with at least an event; analyzing the sports video to extract at least a scene segment from the sports video corresponding to the at least one event defined in the summarization style; and summarizing the sports video based on the at least one scene segment to generate a summarized video corresponds to the summarization style.