I really appreciate the information. I will definitely do that tomorrow, but I was playing with it a bit and it seems that the ms is around 80-100 as soon as I connect via VPN but as soon as I try to open the program from the server, the latency jumps to 300-500ms, sometimes getting as high as 700ms. So what ends up happening is that I try to bring up our program, and it'll come up with the prompt if I want to run it. When I click run, nothing ever pops up, but the latency will never get back to normal because I assume it's still trying to bring up the program. I'm hoping I can get the speeds up, otherwise I'm not sure how else to get all the networks connected to be able to access the program.
Edit: Forgot to mention, I took the server to another internet connection with the same upload speed but I'm still having the issue. I'm starting to wonder if something on the server is causing this or possibly the routers.