Sort should be case insensitive, it is very odd to at least the average user when sorts are case sensitive.

This issue has actually been reported a lot, but across many issues that are not linked and get few votes. Do a search of "sort case sensitive" and you'll see how many come up. I'll add some in a comment to follow.