Symptoms

Crowd becomes unresponsive. A thread dump shows that all threads are in WAITING state, except one which is RUNNABLE and reading from the JDBC socket (SocketInputStream.read) while at the same time holding the WRITE lock in SwitchableTokenManagerImpl.

Postgres logs contain "LOG: could not send data to client: Broken pipe".

Steps to reproduce

This issue is affecting some customers. I haven't been able to reproduce it locally. The key to reproduce this issue seems to be able to kill a connection between Crowd and Postgres in such way that Postgres believes it's closed ("broken pipe"), while Crowd keeps waiting to read from the socket.

This issue seems to happen only when using database token storage.