And you need to take into account "interlacing" as well. This page has excellent illustrations:
http://www.mir.com/DMG/chroma.html
DV Codecs handle all these calculations, in their specific ways. We have the "DV decoder difference" and "DV decoder difference - update" threads here.