Router or Switch ?

I have a router to split my internet conection and to have a small home network.
The problem is that i am already using all 4 ports of my router and I am planing to get at least 2 more devices that nead acces to the network.
So I searched the net for 8 port routers.
I found a switch that has 8 ports and has uplink posibility but I am not shore if that qualifies as router. I am not en expert but I tought that an uplink is a conection to a router or to a server with internett connection.

So my question: Could I use the swich to replace my router?