No, not at all. In fact its probably less stress on the motherboard to only use 4 slots.
RAM profiles don't get much faster beyond dual channel memory anyway. There is a slight jump between single channel and dual channel then quad channel performs much the same as dual channel with no real advantage. So even if your system was running RAM in 8 channel mode you wouldn't notice an improvement with 8x8GB of RAM compared to 4x16GB.
4x16GB DDR4 is very good for high end video editing and intensive server use.