It has to have the right slot for it, you cannot put a PCI-E graphics card on a motherboard that only has AGP and PCI slots, but most modern motherboards have at least one PCI-E 16x slot that will handle most cards. Some new cards are pretty long so you also want to make sure you will have enough space in your case to hold the card.
What card are you looking at and what motherboard do you have?