simply find your external IP address that our ISP provides you. then you can use that when your at the office to connect to your router. I imagine though that you really want to connect to one of the computers in your home and not the router itself. in that case you need to forward the appropriate ports (depending on the application) from the router to the pc that you want to access.
Does that rely on having a static as opposed to dynamic ip address??