No guarantees. You might end up with perfectly good working 12GB of memory (albeit still single channel, since the modules are of different size, except if you are on intel platform where they will work in a hybrid dual-channel mode called flex). But you might also experience inability to POST, BSODs, instabilities and hangs.
The best option is to sell that 4GB stick and get a 16GB dual channel kit (2x8GB).