Oops I guess I forgot to say that. Under brightness in the game, there is only the Gamma setting - I can use a slider for it or put a check mark in "Use desktop gamma".
I'd also like to note that the problem is only really when inside a cave, tunnel etc...where there are darker colours. Outside isn't that bad at all. It seems like when there are dark colours, they take over :P