It wont be conductive. Apart from the obvious physical protection. The whole point of GPU packaging (including the anti static bag) is to isolate the card from possible static damage.
If you're still worried about it though you could wrap the little piece in electrical tape before inserting it, this will definitely keep everything isolated properly.