You will have low performance most likely, because the both pairs have different timings and frencuencies, the best thing to do, is get 8GB (2x4) or 16GB (2x8) so you can get advantage from the Dual Channel setup..
And make sure your OS supports the amount of RAM you're using!