are you ejecting the device or just pulling the USB stick out?
If you pull the stick out without ejecting it first then you will loose files.
If you are ejecting the stick and still getting corruption, it could be the stick, it could be the PC you are using, do you have another one to try?