No problem if starting the board without graphics card. What's the board model?
If inside the case, make sure that the standoffs match the board's screw holes (an extra standoff might cause a short). If outside, put it on a non-conducting surface the board's box, for example).
For some boards, the VGA led will remain lit. Or, if you have connected a case speaker to the mtherboard, you will hear the error beeps signaling that no VGA card is installed.