I believe the mail error queue is held in memory. Basically, we'd run out of memory for our instance, and so mail wasn't going out. I restarted the instance, and then all of the mail in the error queue disappeared. It didn't go out to the users.
I believe it should be persisted somewhere.