I've tested this with IE and Chrome using the admin user.
After the first login attempt, it just goes right back to the login page - no error.
When I try to login again, it works.
We've installed on Linux and Windows, and get the same behavior.
Running version 2.3.2