I did try looking through the QoS window but there were no options which allowed me to limit the bandwidth set aside for WiFi.
If it isn't possible to limit WiFi bandwidth alone, I also wouldn't mind if there was a way to limit the overall speed provided by my ISP for all devices connected to my router. Is there a way to do that?