You have a relatively weak CPU, so it may be causing a bottleneck to this game.
Update:
You'd need to say WHICH game it is, but if it's a pretty recent game it's probably a CPU bottleneck.
Example: http://www.dsogaming.com/pc-performance-analyses/need-for-speed-pc-performance-analysis/
For the settings used (GTX980Ti) they got about 95% CPU utilization. This CPU also has six cores and is approximately 65% faster per core than yours (at stock settings).
Hard to get more specific with system differences, but since THIS game is almost maxing the CPU (or may actually have on at least one core due to thread jumping) a weaker CPU can definitely have a CPU bottleneck.