After you finish reseting and resetting up your router, go to portforwarding.com and you will find directions on doing it for your specific router.
FYI: on the router side the ISPS router gives your Router an IP address as well. Instead of figuring out if you misconfigured the Routers IP address or the IP addresses your router gives to your devices (or any other settings misconfigured) I just had you reset it.