its almost certainly not just cooling the HDD,, but is a key component of getting cool air into your case..
so mostly a HDD just need to have some space around it and it will keep cool enough
But if you take your fan out - you will mess up colling for all your components.
Much better to replace noisy fan with a quieter one.
HTH
Cheers