Possibly. Depends on how the GPO is set. Once set, it may stick around. It could be set as a preference as well.
How would you get around a GPO? Install a different browser.
Also, you might be able to rename Iexplorer.exe to something else and launch that. I haven't played with the restrictions on it but it might work.