It is entirely dependent on your particular rig. Beta drivers will have the newest fixes, but are not fully tested and could potentially be unstable, although that's pretty rare. They are not "worse".
It doesn't really matter which you use, if you have a problem uninstall them and try the other. The latest beta helped a few performance issues for me and I have had no problems at all with them. I tend to install the beta