power up the router without DSL connected, connect your computer to it, open the Command Prompt, and type ipconfig
if it shows an IP starting with either 10. or 192., your router does not require a DSL line and all you need is connect the other computers to the router and you are set to have your LAN party.