How's your CPU Temps? What kind of cooler are you using? What kind of motherboard (power phase)? What kind of power supply?
The 9590 is a hot processor and without a good cooler it may be heating, throttling, leading to crappy FPS. Does it stay at ~20 once it drops or is it constant dropping to 20 and back to 80?