Linksys Wireless Router

Guys,

I'm looking into buying this <A HREF="http://ftp://ftp.linksys.com/datasheet/befw11s4_v2ds.pdf" target="_new">Linksys Wireless Router</A> with the 802.11b technology, with one <A HREF="http://ftp://ftp.linksys.com/datasheet/wusb11_v2.6_ds.pdf" target="_new">Wireless USB Network Adapter</A> and one regular NIC for use with Internet 4Mbits cable connection. Now, one computer is in the basement and the other on the second floor, where cable connection is. My question is, will there be any problem for the basement computer to connect to Internet via the Wireless network? Anyone had experience with this?
Do I need any other equipment for this to work, besides the RJ45 cable for the regular NIC?

<font color=red>A platform is not an oil rig.</font color=red>