the x4 pcie slot is just another pcie slot that will run at a slower speeds. It would probably slow down the overall system a bit.
If you put another card in the system, your cards will both run at the lowest speeds from my understanding, which would be the x4. That would probably slow down the cards a bit, I'm not sure, but it's probably not worth it to Crossfire with that lane.