The non-reactivity of chlorine atom in vinyl chloride is due to resonance stabilisation. The lone pair on chlorine can participate in delocalisation (resonance) to give two cannonical structures.
The carbon-chlorine bond in vinyl chloride has some double bond character and is therefore stronger than a pure single bond.