That's quite an upgrade from a 5770
, I'm currently using a 5770 and looking for an upgrade as well.
Obviously with a 580, 4GB ram, the cpu is the weak link in your PC. If your performance is lacking a bit this would be the next item to upgrade imo. However, if you can get away with medium or so settings, it might be ok as is. Your assumption is correct though.