go with the 460 or the 5770 if the 460 is out of your budget
Just to edit. I'd go for them in this order GTX460 1GB > GTX460 768MB > 5770 1GB.
What power supply do you have? If you ran a 8800Gt before, it will definitely run a 5770. A GTX460 takes a little more power.