How do I test to see what the frame rate is in games (ie bioshock)  to see what frame rate I am getting???  Is it a feature within the actual game?

FRAPS google it

Some games have a timedemo feature that will benchmark the game for you, otherwise use fraps and tell it to do an average fps counter during play.
 
http://www.fraps.com/

I run ATI Tray Tools which has a FPS and temp guage that you can keep in the upper right corner. I use it to watch my GPU temp and FPS. I use it to OC my ATI card though but have heard people use it for Nvidia as well.

Thanks guys!
 
  I tested out Bioshock at 1920x1080 with everything on high.  I have XP so I do not have direct x10 things on, but I am pretty pleased and surprised to see on average I got 51fps on a 8800 gts 320mb, 2gig ram, core duo allen dale 1.8 ghz rig..  I have nothing overclocked either....