Yes, it matters. The standoffs provide grounding points on the motherboard to the case. Also, an area without it's standoff will be more likely to come in contact with the motherboard tray resulting in a short.
Well basicly the missing stand off is where I want it to be. I will still most likely just buy a few I think radioshack has some so ill check there later.