As elibgrad stated, a smart person can easily undo this since all users have admin access.
You can block even people in the administrator group from having access to change group policy, you will need to make sure you setup an account to be able to change the settings later though. For example, at work we have several levels of users, unless you are in the Level 1 user group, you cannot run regedit and do not have the Run command, restrictions like that. Even if your account is a local admin, you can't run regedit. Can do the same thing for group policy editor.
A user account may be part of the local admin group, but if that group is removed from the rights to edit group policy, they won't be able to.
This is best done in a domain setting though. Locally, you'd have to make sure you have an account setup that does have edit rights or you will be stuck in a loop.