If I understood what you wrote correctly, this is a dangerous mis-statement. If I misunderstood and my criticism is gross calumny, I apologize in advance.
Hot-swapping means that you can remove or add hardware while the system is running. If you remove a drive that is cached without going through the eject process, there is a significant chance of corrupting some or all of your data.
If you disable caching on the drive as you describe, it is still a good idea to eject before removing to prevent the situation that you describe, removing the drive while it is writing.
Always, always go through the "Safely Remove Hardware" process before removing a disk from a running system.