it could also be that your client isn't set to delete the messages from the server, thus each times it checks for new mail it downloads again all emails included those previously deleted.
Tell us what client you're using and i'm sure someone will be able to guide you to the right settings