No, in no way shape or form will V-Sync damage your card. All it does is wait for the screen to be ready to refresh before swapping out the current frame in the frame buffer to the next completed frame. The reason that it makes your frame rate decrease is that it is quite literally waiting around for your monitor to be ready to swap frames instead of just swapping mid refresh which is faster but causes screen tearing.