You will need a long Ethernet cable going from the router to the modem. Or just leave the router where it is and run a long Ethernet cable to the PS4 from the router.
If you have a 2nd router, it is technically possible to set it up as a 2nd access point, but if you are gaming with a PS4 I would not recommend this. Connection could get spotty.