You wouldn't see much (if any) increase and may actually see a decrease in overall performance since you would no longer be in a tri-channel config. To maintain the 3 channels, you need to keep matched sets in place. That means you go with 3GB or 6GB or 9GB or 12GB, etc, via 3 or 6 DIMM combinations.
Good luck!