Most of the time, yes. It depends on the motherboard though. In those cases where a PCI-e 2.1 card does not work in a PCI-e 1.0/1.1 slot, it has been speculated that the PCI-e slot was not implemented properly by the manufacturer.
Basically, It's a shot in the dark with a small chance that it may not work.