What should I do for this?
As described above.
Use an Ethernet cable to connect your router to an access point. The AP need not be capable as a DSL modem, so practically any one you can buy will do. If you absolutely cannot run an Ethernet cable, then powerline networking is the second best option to get the network upstairs and can include an AP built into the device.