UI slows down, large amount of memory being used

This is pretty much the same issue that has been brought up several times before, but I figured I'd bring it up yet again for the latest version.

ST over time will start to slow down (repo refreshes take longer, gets laggier), and memory usage goes very high. I'm seeing 1GB Memory usage in Activity Monitor, Private Memory is 768MB. It's using more memory than anything else, including Xcode and Safari combined.

Once I quit and relaunch and bring back the repo window, it's back down to 33MB Private.

Since I believe the app is using ARC now, there's got to be some excessive caching going on that is affecting this.

I am on 10.11.5.