Hearing "patch panel" immediately makes me think Medium to Enterprise.
What kind of switch? Dumb switch or managed? How is your network segmented?
Why are you asking this question on forums?
Your question is scary like hearing someone say "I'm installing a 1200 volt line, what's the difference between AC and DC"