A video signal processing method and apparatus eliminates dot crawls and cross color interferences from a component video signal that has been subjected to Y/C separation. Components at a horizontal frequency of 3.58 MHz and a temporal frequency of 15 Hz are extracted from luminance signal data using a horizontal filter and a time filter. When the absolute value of the component value is equal to or larger than a predetermined value, an output of the horizontal filter is subtracted from the luminance signal data by a subtracter, thereby eliminating dot crawls.