I just tried it a few times with a few users on a number of browsers. I made the change, logged out, logged in - it worked every time, with all browsers and for all users.
The only thing I can imagine is that something about your browser's cache may interfere. You may want to try deleting all cache and remove all cookies of your browser. This means you need to delete all history. Then, give it a try. You can also try other browsers.
Let us know if that helped fix.