99% of the home routers out there today have 4 port switches and one wan port in them, many have wireless in them as well. You can connect any computer to any of the 4 switch ports.
If you are after a simple setup and fairly reliable router go for a linksys. They come with setup cds that make it pretty painless
My recommendation would be the Linksys WRT54GL or WRT54G. If you have a local staples or similar store they probably have one of those.