Well, using Wi-Fi & Ethernet at the same time means that you have 2 (or more) devices sharing the connection. That's not a problem if there's enough bandwidth to share (i.e. if you have a 30Mbps connection but only need 10Mbps for what you're using the Internet for, then 2 or even 3 devices can share the data easily). If you don't have enough bandwidth, however, then you're going to see slowdown (i.e. if you only have a 10Mbps connection, connecting 2 devices means you're limiting each one to about 5Mbps each...which, if your usage depends on a 10Mbps connection, means you'll start seeing slowdown & "buffering").
Run a speedtest & QoS test on your connections:
-- Wi-Fi by itself
-- Ethernet by itself
-- Ethernet & Wi-Fi...