Yes, you can. Consult the literature which came with the router (or download the manual) and read up on how to access the router's setup screens. You'll need to connect the computer to the router via an ethernet cable (one usually comes in the package with the router).
Facebook
Twitter
Instagram