Your pen drive space is getting smaller though you have not added anything?
It sounds like virus attack problem.
You should scan your pen drive with an anti-virus software to remove the virus. Then if you find anything lost, you can use recovery tool to restore it. For example, 4Card Recovery. It is a professional recovery software.
Have a try.