Details
-
Bug
-
Resolution: Fixed
-
High
-
8.5.19, 8.13.11, 8.19.1
-
8.05
-
43
-
Severity 2 - Major
-
26
-
-
Description
Issue Summary
When cached data is updated by UPM, it updates the database and invalidates the CachingOfBizPropertyEntryStore cache. This invalidated all entries with ‘entityName =jira.properties, entityId = 1’ keys, all the requests trying to access any data from jira.properties, tries to load the cache or get blocked by the others.
Steps to Reproduce
- Generate high load
- Navigate to Administration > Manage apps > Find new apps to trigger a request to /rest/plugins/1.0/notifications to invalidate the cache or install/uninstall/update an app
Expected Results
Jira performing without any performance issue
Actual Results
Threads are blocked by the threads running to load the cache.
Additional logs enabled via ByteCat shows the notification requests from UPM causing cache invalidation on entityName = jira.properties, entityId = 1
2021-10-07 04:56:25,484+0200 https-jsse-nio-8443-exec-1 url: /rest/plugins/1.0/notifications; user: username WARN username 123x45678x9 abcdef 192.168.1.1 /rest/plugins/1.0/notifications [Logging] CachingOfBizPropertyEntryStore.invalidateCacheEntry entityName = jira.properties, entityId = 1 2021-10-07 04:56:25,521+0200 https-jsse-nio-8443-exec-1 url: /rest/plugins/1.0/notifications; user: username WARN username 123x45678x9 abcdef 192.168.1.1 /rest/plugins/1.0/notifications [Logging] CachingOfBizPropertyEntryStore.loadPropertySetData onCacheMiss entityName = jira.properties, entityId = 1 2021-10-07 04:56:26,727+0200 https-jsse-nio-8443-exec-1 url: /rest/plugins/1.0/notifications; user: username WARN username 123x45678x9 abcdef 192.168.1.1 /rest/plugins/1.0/notifications [Logging] CachingOfBizPropertyEntryStore.invalidateCacheEntry entityName = jira.properties, entityId = 1 2021-10-07 04:56:26,753+0200 https-jsse-nio-8443-exec-1 url: /rest/plugins/1.0/notifications; user: username WARN username 123x45678x9 abcdef 192.168.1.1 /rest/plugins/1.0/notifications [Logging] CachingOfBizPropertyEntryStore.loadPropertySetData onCacheMiss entityName = jira.properties, entityId = 1 2021-10-07 04:56:27,840+0200 https-jsse-nio-8443-exec-1 url: /rest/plugins/1.0/notifications; user: username WARN username 123x45678x9 abcdef 192.168.1.1 /rest/plugins/1.0/notifications [Logging] CachingOfBizPropertyEntryStore.invalidateCacheEntry entityName = jira.properties, entityId = 1 2021-10-07 04:56:27,867+0200 https-jsse-nio-8443-exec-1 url: /rest/plugins/1.0/notifications; user: username WARN username 123x45678x9 abcdef 192.168.1.1 /rest/plugins/1.0/notifications [Logging] CachingOfBizPropertyEntryStore.loadPropertySetData onCacheMiss entityName = jira.properties, entityId = 1 2021-10-07 04:56:28,980+0200 https-jsse-nio-8443-exec-1 url: /rest/plugins/1.0/notifications; user: username WARN username 123x45678x9 abcdef 192.168.1.1 /rest/plugins/1.0/notifications [Logging] CachingOfBizPropertyEntryStore.invalidateCacheEntry entityName = jira.properties, entityId = 1
Workaround
UPM may clear the sensitive jira.properties cache when triggering some actions related to apps management. It is recommended to not perform any apps management during business hours.
Add-on changes should be performed during maintenance windows to minimize the impact on users.
You may want to block the GET requests to /rest/plugins/1.0/notifications endpoint on your load balancer or proxy. This will cause fewer cache flushes. This will prevent admin messages generated by UPM (Universal Plugin Manager component) regarding Apps on your system while in effect.
Attachments
Issue Links
- is related to
-
-
- Closed
-
-
-
- Closed
-
- relates to
-
-
- Closed
-
-
JRASERVER-69963 Make UPM update not impact all other installed apps
- Gathering Interest
-
MNSTR-6259 Loading...
- mentioned in
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-