BTX case sucks, there are no replacement for that case, I been looking for this sometime ago and could not find one.
This little guide explains the "fit" issue.
THIS POST APPLICABLE TO MT (MINI TOWER) FORM FACTOR ONLY.
Unfortunately no card that is more than 7.5 inches long or 2 slots wide will PHYSICALLY FIT inside the case - it was found that only single bracket video card can fit due to BTX MOBO, where card internals facing upward towards PC internals, not ATX, where dual card design is blocking another PCI slot by facing downward.
If you prefer the card with beefier fan, then the length of the card must not exceed 7.5 inches, otherwise only "skinny" single bracket, single slot cards can physically fit.
Pictures below will prove my point.
View shows no room for dual bracket
Single bracket only, or you have to cut dual bracket in half
This is the other way to show my point
Here you can clearly see only single place for the bracket
Visual explanation
7.5 inches explained, also shown "obstacles"
This is the picture of actual "skinny" single slot video card (not sure which model)- perfect, "glove" fit.
So if you have dual card you pretty much in deep troubles. Single slot with massive cooler might fit after serious case modification.
Anything else I can help you with?