It depends on the pin.
For example, it may be connected to your System RAM and prevent all of your memory from being accessed.
If it was critical you'd probably have a major issue. Every pin has a purpose but again there are exceptions where it may not be needed on your configuration.