yes just connect the cable between the two. at one point you needed a cross over... but modern network cards ( ones built in to motherboards ) a cross over cable is not required,, if you wish to add more a 8 port hub is ideal.
if your have a broadband then the best way is to use a router
If you have a broadband connection system, look closely (or ask you service provider) at the box that they supplied to bring the signal to your computer. Your computer very likely is already using a network cable connection to this box for its internet signal. SOME of those boxes are more than just a simple connection point (sometimes called a "modem"). SOME actually are a small router, too, with more than one network connector on it so you can hook up more than one computer and share the internet connection. If you happen to have one of these, you may be able to simply plug your second computer in there. You would get not only access to the internet for the second computer, but also a simple network connection between both of your machines.