I order to check which RAM stick has errors, you should pull out one stick, and run the RAM test again, for both sticks because both sticks might be defective. I would say that checking for a working stick of RAM is worth it considering a 8GB stick is worth around $80.
It is not a problem replacing a single defective RAM as long as you get a similarly specced stick of RAM, ideally from the same brand.
Thanks for the advice. Figured out which RAM was faulty and exchanged it immediately. Everything is running well, so far so good.