Is your processor 64 bit capable? Something tells me no. But if it is, that is an option.
However, game load times aren't solely RAM dependent, in fact many games don't require any more than 4GB of RAM to run well. A lot of other factors contribute to load times.