In this paper, a video stabilization technique based on Dynamic Displacement Field (DDF) model is introduced to stabilize the spatially variable distorted image sequence. Based on motion filtering technique of the spatially invariable image sequence, motion estimation and frequency filtering techniques of the spatially variable image sequence are used to stabilize the projective distorted image sequence. Experimental results show that the proposed method removes high-frequency jitter and stabilize the projective distortion after motion filtering. If we know the physical factors that create the distortion, we can correct the projective distortion while stabilize the projective distortion. It can not only be potentially applied in video stabilization system but also be applied in other practical spatially variable distortion correction fields.