My apologies, was not intending to upset you. I was trying to stress that defragmenting is not going to solve much, but can come with overhead of it's own. I have known people to defragment their drives daily, and even recall a screen saver that would defragment hard drives pretty much whenever a computer sat idle.
Let's try and look at it another way...
Think of your hard drive like a car, that is warranted for 100,000 miles. Defragmenting is like putting extra mileage on your car, for very little return. Say, like driving 1000 extra miles to get your oil changed. The more often you do it, the more you are stressing your device.
There are different methods to defragmenting, however, and if you are not trying to be cute about the defragmentation, you minimize the stress to the drive. Microsoft does what's needed to be done, and little else. Gains from trying to shoehorn your files to certain locations on a drive, while sometimes achievable, take a lot of time, and should be done based on the access patterns to your files. As you change your access patterns, your drive would need to be optimized yet again. The gains here are likely to be lost from the speed at which most external devices can transfer data to and from your computer.
Eventually, everything wears out, and I'm not a fan of helping that along, as in the end, that just costs money. Microsoft has picked a good interval for defragmenting, which is weekly. Any more than that is just unnecessary, and I would say almost wasteful, of your time, of the equipment's usable life, electricity, etc., for almost no appreciable gains. If you're worried about the time it takes to load your sound library, the first thing I would do is get a faster storage solution to load your libraries from.
Rest assured, you haven't hurt your drives by defragmenting them, you've simply used them, as intended, to read and write data. Just remember that every mile adds up.