sounds like heat, something is overheating and throttling back. also, reinstall your display drivers, donwload the latest from amd website,.
I just did a clean install of drivers again, but everything is still the same. The temps on both gpu and cpu never passes 60 degrees. Also, when the frame drops happen, my gpu load goes to 0.