They are designed to keep the ports from shorting or impacting against the I/O shield. Its best to leave them on.
It may seem hard to install the board the first time around, but once they get bent back they are less of a nuisance. If they are blocking the way (mine were) I simply bent them flatter and everything went fine.