Uploaded image for project: 'Jira Cloud'
  1. Jira Cloud
  2. JRACLOUD-65446

Successive Imports fail due to OOME

    XMLWordPrintable

Details

    Description

      Summary

      Doing a second JIRA Import right after another import fails with a Out Of Memory Error.
      On the stage "Starting the JIRA Plugin System"

      Environment

      • JIRA Cloud

      Steps to Reproduce

      1. Create a brand new JIRA Cloud site
      2. Create 1 project, 1 issue
      3. Export JIRA with or without attachments
      4. Re-zip contents following How to restore a JIRA Cloud application backup into another JIRA Cloud application or just use the previous export if it was not done with attachments.
      5. do "JIRA Import" using the backup.zip and attachments.zip packed on previous step
      6. Wait for JIRA to finish importing
      7. Do again a "JIRA Import" using the same files

      Expected Results

      Backup is imported again with no errors

      Actual Results

      JIRA runs out of memory and import fails to complete. First the timeout "Page unavailable" is shown and then:

      This appears in the logs:

      2016-02-16 15:27:06.942277500 Heap dump file created [545436715 bytes in 9.737 secs]
      2016-02-16 15:27:09.744724500 #
      2016-02-16 15:27:09.744725500 # java.lang.OutOfMemoryError: Metaspace
      2016-02-16 15:27:09.744726500 # -XX:OnOutOfMemoryError="/sw/scripts/support/bin/studio_jvm_oome"
      2016-02-16 15:27:09.744727500 #   Executing /bin/sh -c "/sw/scripts/support/bin/studio_jvm_oome"...
      2016-02-16 15:27:09.821734500 removing old heap dumps...
      2016-02-16 15:27:09.844176500 2016-02-16 15:27:05,678 ThreadPoolAsyncTaskExecutor::Thread 11 ERROR mbadii 925x408x1 exrp55 59.167.133.100,10.69.1.244,127.0.0.1 /secure/admin/StudioImport!import.jspa [c.a.p.osgi.factory.OsgiPlugin] Unable to start the plugin container for plugin 'com.pyxis.greenhopper.jira'
      2016-02-16 15:27:09.844179500 java.lang.OutOfMemoryError: Metaspace
      2016-02-16 15:27:09.844180500 	at java.lang.ClassLoader.defineClass1(Native Method)
      2016-02-16 15:27:09.844180500 	at java.lang.ClassLoader.defineClass(ClassLoader.java:760)
      2016-02-16 15:27:09.844227500 	at org.apache.felix.framework.BundleWiringImpl$BundleClassLoader.findClass(BundleWiringImpl.java:2279)
      2016-02-16 15:27:09.844227500 	at org.apache.felix.framework.BundleWiringImpl.findClassOrResourceByDelegation(BundleWiringImpl.java:1501)
      2016-02-16 15:27:09.844228500 	at org.apache.felix.framework.BundleWiringImpl.access$400(BundleWiringImpl.java:75)
      2016-02-16 15:27:09.844229500 	at org.apache.felix.framework.BundleWiringImpl$BundleClassLoader.loadClass(BundleWiringImpl.java:1955)
      2016-02-16 15:27:09.844235500 	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
      2016-02-16 15:27:09.844236500 	at org.apache.felix.framework.Felix.loadBundleClass(Felix.java:1844)
      2016-02-16 15:27:09.844237500 	at org.apache.felix.framework.BundleImpl.loadClass(BundleImpl.java:937)
      2016-02-16 15:27:09.844244500 	at org.eclipse.gemini.blueprint.util.BundleDelegatingClassLoader.findClass(BundleDelegatingClassLoader.java:135)
      2016-02-16 15:27:09.844245500 	at org.eclipse.gemini.blueprint.util.BundleDelegatingClassLoader.loadClass(BundleDelegatingClassLoader.java:211)
      2016-02-16 15:27:09.844246500 	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
      2016-02-16 15:27:09.844246500 	at org.springframework.util.ClassUtils.forName(ClassUtils.java:249)
      2016-02-16 15:27:09.844251500 	at org.springframework.beans.factory.support.AbstractBeanDefinition.resolveBeanClass(AbstractBeanDefinition.java:395)
      2016-02-16 15:27:09.844252500 	at org.springframework.beans.factory.support.AbstractBeanFactory.doResolveBeanClass(AbstractBeanFactory.java:1349)
      2016-02-16 15:27:09.844253500 	at org.springframework.beans.factory.support.AbstractBeanFactory.resolveBeanClass(AbstractBeanFactory.java:1320)
      2016-02-16 15:27:09.844258500 	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.determineTargetType(AbstractAutowireCapableBeanFactory.java:622)
      2016-02-16 15:27:09.844259500 	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.predictBeanType(AbstractAutowireCapableBeanFactory.java:591)
      2016-02-16 15:27:09.844260500 	at org.springframework.beans.factory.support.AbstractBeanFactory.isFactoryBean(AbstractBeanFactory.java:1397)
      2016-02-16 15:27:09.844268500 	at org.springframework.beans.factory.support.DefaultListableBeanFactory.doGetBeanNamesForType(DefaultListableBeanFactory.java:434)
      2016-02-16 15:27:09.844269500 	at org.springframework.beans.factory.support.DefaultListableBeanFactory.getBeanNamesForType(DefaultListableBeanFactory.java:404)
      2016-02-16 15:27:09.844270500 	at org.eclipse.gemini.blueprint.context.support.AbstractDelegatedExecutionApplicationContext.invokeBeanFactoryPostProcessors(AbstractDelegatedExecutionApplicationContext.java:389)
      2016-02-16 15:27:09.844275500 	at org.eclipse.gemini.blueprint.context.support.AbstractDelegatedExecutionApplicationContext.invokeBeanFactoryPostProcessors(AbstractDelegatedExecutionApplicationContext.java:362)
      2016-02-16 15:27:09.844277500 	at org.eclipse.gemini.blueprint.context.support.AbstractDelegatedExecutionApplicationContext$3.run(AbstractDelegatedExecutionApplicationContext.java:254)
      2016-02-16 15:27:09.844282500 	at org.eclipse.gemini.blueprint.util.internal.PrivilegedUtils.executeWithCustomTCCL(PrivilegedUtils.java:85)
      2016-02-16 15:27:09.844282500 	at org.eclipse.gemini.blueprint.context.support.AbstractDelegatedExecutionApplicationContext.startRefresh(AbstractDelegatedExecutionApplicationContext.java:220)
      2016-02-16 15:27:09.844290500 	at org.eclipse.gemini.blueprint.extender.internal.dependencies.startup.DependencyWaiterApplicationContextExecutor.stageOne(DependencyWaiterApplicationContextExecutor.java:224)
      2016-02-16 15:27:09.844291500 	at org.eclipse.gemini.blueprint.extender.internal.dependencies.startup.DependencyWaiterApplicationContextExecutor.refresh(DependencyWaiterApplicationContextExecutor.java:177)
      2016-02-16 15:27:09.844297500 	at org.eclipse.gemini.blueprint.context.support.AbstractDelegatedExecutionApplicationContext.refresh(AbstractDelegatedExecutionApplicationContext.java:157)
      2016-02-16 15:27:09.844298500 	at org.eclipse.gemini.blueprint.extender.internal.activator.LifecycleManager$1.run(LifecycleManager.java:207)
      2016-02-16 15:27:09.844306500 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      2016-02-16 15:27:09.844307500 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      2016-02-16 15:27:09.874865500 Sleeping 20s to increase likelihood of OOME stacktrace appearing in application log before gathering diagnostics.
      2016-02-16 15:27:21.853840500 2016-02-16 15:27:09,827 JiraImportTaskExecutionThread-1 INFO mbadii 925x408x1 exrp55 59.167.133.100,10.69.1.244,127.0.0.1 /secure/admin/StudioImport!import.jspa [c.a.plugin.util.WaitUntil] Plugins that have yet to be enabled: (106): [com.atlassian.oauth.serviceprovider, com.atlassian.servicedesk.plugins.automation.servicedesk-automation-modules-plugin, com.atlassian.streams, com.atlassian.servicedesk.servicedesk-reports-plugin, com.atlassian.jira.plugins.jira-importers-bitbucket-plugin, com.atlassian.servicedesk.approvals-plugin, com.atlassian.bonfire.plugin, com.atlassian.mywork.mywork-common-plugin, com.atlassian.plugin.timedpromise.atlassian-timed-promise-plugin, com.atlassian.jira.jira-issue-link-applinks-common-plugin, com.atlassian.jira.jira-view-issue-plugin, com.atlassian.activeobjects.activeobjects-plugin, com.atlassian.jira.plugins.inline-create.jira-inline-issue-create-plugin, com.atlassian.jira.jira-quick-edit-plugin, com.atlassian.jira.jira-mail-plugin, com.atlassian.servicedesk.public-rest-api, com.atlassian.mywork.mywork-jira-provider-plugin, com.atlassian.jira.plugins.jira-importers-plugin, com.atlassian.streams.actions, com.atlassian.jira.jira-issue-link-remote-jira-plugin, com.atlassian.labs.hipchat.hipchat-for-jira-plugin, com.atlassian.jira.plugins.jira-importers-asana-plugin, com.atlassian.plugins.base-hipchat-integration-plugin, com.atlassian.studio.theme.jira, com.atlassian.jira.plugins.jira-importers-redmine-plugin, com.atlassian.jira.plugins.jira-development-integration-plugin, com.atlassian.gadgets.opensocial, com.atlassian.jira.jira-projects-plugin, com.atlassian.jira.plugins.jira-software-plugin, com.atlassian.servicedesk.servicedesk-knowledge-base-plugin, com.atlassian.jira.plugins.jira-ads-plugin, com.atlassian.plugins.atlassian-project-creation-plugin, com.atlassian.applinks.applinks-cors-plugin, com.atlassian.jira.plugins.jira-healthcheck-plugin, com.atlassian.jira.jira-invite-user-plugin, com.atlassian.jirafisheyeplugin, com.atlassian.plugins.base-hipchat-integration-plugin-api, com.atlassian.plugins.atlassian-whitelist-api-plugin, com.atlassian.jira.plugins.workflow.sharing.jira-workflow-sharing-plugin, com.atlassian.crowd.user-provisioning-plugin, com.atlassian.jira.jira-ondemand-onboarding-emails-plugin, com.atlassian.administration.atlassian-admin-quicksearch-jira, com.atlassian.teams, com.atlassian.studio.static, com.atlassian.upm.atlassian-universal-plugin-manager-plugin, com.atlassian.jira.jira-ondemand-invite-user-plugin, com.atlassian.jira-core-project-templates, com.atlassian.jira.jira-ondemand-jim-bridge-plugin, com.atlassian.streams.streams-jira-plugin, com.atlassian.plugins.rest.atlassian-rest-module, com.atlassian.jira.plugins.workinghours, com.atlassian.jira.plugins.jira-importers-trello-plugin, com.atlassian.servicedesk, com.atlassian.jira.project-templates-plugin, com.atlassian.applinks.applinks-trustedapps-plugin, com.atlassian.upm.plugin-installer-plugin, com.atlassian.streams.streams-thirdparty-plugin, com.atlassian.plugins.atlassian-whitelist-ui-plugin, com.atlassian.pas, com.atlassian.jira.collector.plugin.jira-issue-collector-plugin, com.atlassian.jira.jira-header-plugin, com.atlassian.studio.studio-haup-plugin, io.atlassian.blobstore.blobstore-migration-jira-plugin, com.atlassian.gadgets.directory, com.atlassian.plugins.atlassian-remote-event-common-plugin, com.atlassian.crowd.embedded.admin, com.atlassian.jira.plugins.jira-bitbucket-connector-plugin, io.atlassian.blobstore.blobstore-client-plugin, com.atlassian.applinks.applinks-plugin, com.atlassian.jirawallboard.atlassian-wallboard-plugin, com.atlassian.jira.plugins.jira-importers-github-plugin, com.atlassian.analytics.analytics-client, com.atlassian.studio.studio-ual-jira-plugin, com.atlassian.applinks.applinks-basicauth-plugin, com.atlassian.jira.plugins.jira-transition-triggers-plugin, com.atlassian.jira.jira-issue-nav-plugin, com.atlassian.webhooks.atlassian-webhooks-plugin, com.atlassian.jira.mobile.jira-mobile-rest, com.atlassian.ondemand.backupmanager.ondemand-backup-manager-jira, com.atlassian.plugins.atlassian-nav-links-plugin, com.atlassian.jwt.jwt-plugin, com.atlassian.gadgets.oauth.serviceprovider, com.atlassian.plugins.jira-remote-link-aggregator-plugin, com.atlassian.fusion.plugins.atlassian-connect-integration-plugin, com.atlassian.jpo, com.atlassian.plugins.atlassian-remote-event-consumer-plugin, com.atlassian.jira.rest, com.atlassian.growth.experiments-plugin, com.atlassian.jira.plugins.webhooks.jira-webhooks-plugin, com.atlassian.jira.jira-issue-nav-components, com.atlassian.jira.jira-issue-link-confluence-plugin, com.atlassian.jira.extra.jira-confluence-view-plugin, com.atlassian.jira.jira-project-config-plugin, com.atlassian.gadgets.dashboard, com.atlassian.servicedesk.plugins.servicedesk-search-plugin, com.atlassian.gadgets.embedded, com.atlassian.plugins.atlassian-awareness-capability, com.atlassian.applinks.applinks-oauth-plugin, com.atlassian.jira.gadgets, com.pyxis.greenhopper.jira, com.radiantminds.roadmaps-jira, com.atlassian.jira.jira-projects-issue-navigator, com.atlassian.servicedesk.plugins.automation.servicedesk-automation-plugin, com.atlassian.servicedesk.project-ui, com.atlassian.jira.plugin.ext.bamboo, com.atlassian.plugins.atlassian-connect-plugin], 579 seconds remaining
      2016-02-16 15:27:21.882192500 2016-02-16 15:27:20,508 ThreadPoolAsyncTaskExecutor::Thread 13 WARN mbadii 925x408x1 exrp55 59.167.133.100,10.69.1.244,127.0.0.1 /secure/admin/StudioImport!import.jspa [o.s.b.factory.support.DefaultListableBeanFactory] FactoryBean threw exception from getObjectType, despite the contract saying that it should return null if the type of its object cannot be determined yet
      2016-02-16 15:27:21.882195500 java.lang.OutOfMemoryError: Metaspace
      2016-02-16 15:27:24.586940500 2016-02-16 15:27:21,854 ThreadPoolAsyncTaskExecutor::Thread 5 ERROR mbadii 925x408x1 exrp55 59.167.133.100,10.69.1.244,127.0.0.1 /secure/admin/StudioImport!import.jspa [c.a.p.osgi.factory.OsgiPlugin] Unable to start the plugin container for plugin 'com.atlassian.jira.plugins.jira-transition-triggers-plugin'
      2016-02-16 15:27:24.586944500 org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'workflowTriggerTransitionProcessor': Unsatisfied dependency expressed through constructor argument with index 11 of type [com.atlassian.jira.plugin.triggers.impl.transition.failures.TransitionFailureService]: : Error creating bean with name 'defaultTransitionFailureService': Unsatisfied dependency expressed through constructor argument with index 0 of type [com.atlassian.pocketknife.api.querydsl.DatabaseAccessor]: : Error creating bean with name 'databaseAccessorImpl': Unsatisfied dependency expressed through constructor argument with index 0 of type [com.atlassian.pocketknife.api.querydsl.DatabaseConnectionConverter]: : Error creating bean with name 'databaseConnectionConverterImpl': Unsatisfied dependency expressed through constructor argument with index 0 of type [com.atlassian.pocketknife.api.querydsl.schema.DialectProvider]: : Error creating bean with name 'defaultDialectConfiguration': Bean instantiation via constructor failed; nested exception is java.lang.OutOfMemoryError: Metaspace; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'defaultDialectConfiguration': Bean instantiation via constructor failed; nested exception is java.lang.OutOfMemoryError: Metaspace; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'databaseConnectionConverterImpl': Unsatisfied dependency expressed through constructor argument with index 0 of type [com.atlassian.pocketknife.api.querydsl.schema.DialectProvider]: : Error creating bean with name 'defaultDialectConfiguration': Bean instantiation via constructor failed; nested exception is java.lang.OutOfMemoryError: Metaspace; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'defaultDialectConfiguration': Bean instantiation via constructor failed; nested exception is java.lang.OutOfMemoryError: Metaspace; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'databaseAccessorImpl': Unsatisfied dependency expressed through constructor argument with index 0 of type [com.atlassian.pocketknife.api.querydsl.DatabaseConnectionConverter]: : Error creating bean with name 'databaseConnectionConverterImpl': Unsatisfied dependency expressed through constructor argument with index 0 of type [com.atlassian.pocketknife.api.querydsl.schema.DialectProvider]: : Error creating bean with name 'defaultDialectConfiguration': Bean instantiation via constructor failed; nested exception is java.lang.OutOfMemoryError: Metaspace; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'defaultDialectConfiguration': Bean instantiation via constructor failed; nested exception is java.lang.OutOfMemoryError: Metaspace; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'databaseConnectionConverterImpl': Unsatisfied dependency expressed through constructor argument with index 0 of type [com.atlassian.pocketknife.api.querydsl.schema.DialectProvider]: : Error creating bean with name 'defaultDialectConfiguration': Bean instantiation via constructor failed; nested exception is java.lang.OutOfMemoryError: Metaspace; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'defaultDialectConfiguration': Bean instantiation via constructor failed; nested exception is java.lang.OutOfMemoryError: Metaspace; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'defaultTransitionFailureService': Unsatisfied dependency expressed through constructor argument with index 0 of type [com.atlassian.pocketknife.api.querydsl.DatabaseAccessor]: : Error creating bean with name 'databaseAccessorImpl': Unsatisfied dependency expressed through constructor argument with index 0 of type [com.atlassian.pocketknife.api.querydsl.DatabaseConnectionConverter]: : Error creating bean with name 'databaseConnectionConverterImpl': Unsatisfied dependency expressed through constructor argument with index 0 of type [com.atlassian.pocketknife.api.querydsl.schema.DialectProvider]: : Error creating bean with name 'defaultDialectConfiguration': Bean instantiation via constructor failed; nested exception is java.lang.OutOfMemoryError: Metaspace; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'defaultDialectConfiguration': Bean instantiation via constructor failed; nested exception is java.lang.OutOfMemoryError: Metaspace; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'databaseConnectionConverterImpl': Unsatisfied dependency expressed through constructor argument with index 0 of type [com.atlassian.pocketknife.api.querydsl.schema.DialectProvider]: : Error creating bean with name 'defaultDialectConfiguration': Bean instantiation via constructor failed; nested exception is java.lang.OutOfMemoryError: Metaspace; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'defaultDialectConfiguration': Bean instantiation via constructor failed; nested exception is java.lang.OutOfMemoryError: Metaspace; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'databaseAccessorImpl': Unsatisfied dependency expressed through constructor argument with index 0 of type [com.atlassian.pocketknife.api.querydsl.DatabaseConnectionConverter]: : Error creating bean with name 'databaseConnectionConverterImpl': Unsatisfied dependency expressed through constructor argument with index 0 of type [com.atlassian.pocketknife.api.querydsl.schema.DialectProvider]: : Error creating bean with name 'defaultDialectConfiguration': Bean instantiation via constructor failed; nested exception is java.lang.OutOfMemoryError: Metaspace; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'defaultDialectConfiguration': Bean instantiation via constructor failed; nested exception is java.lang.OutOfMemoryError: Metaspace; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'databaseConnectionConverterImpl': Unsatisfied dependency expressed through constructor argument with index 0 of type [com.atlassian.pocketknife.api.querydsl.schema.DialectProvider]: : Error creating bean with name 'defaultDialectConfiguration': Bean instantiation via constructor failed; nested exception is java.lang.OutOfMemoryError: Metaspace; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'defaultDialectConfiguration': Bean instantiation via constructor failed; nested exception is java.lang.OutOfMemoryError: Metaspace
      2016-02-16 15:27:24.588031500 	at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:749)
      2016-02-16 15:27:24.588032500 	at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:185)
      2016-02-16 15:27:24.588037500 	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1139)
      2016-02-16 15:27:24.588038500 	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1042)
      2016-02-16 15:27:24.588039500 	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:504)
      2016-02-16 15:27:24.588044500 	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:476)
      2016-02-16 15:27:24.588050500 	at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:303)
      2016-02-16 15:27:24.588050500 	at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
      2016-02-16 15:27:24.588051500 	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:299)
      2016-02-16 15:27:24.588056500 	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:194)
      2016-02-16 15:27:24.588057500 	at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:755)
      2016-02-16 15:27:24.588058500 	at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:757)
      2016-02-16 15:27:24.588062500 	at org.eclipse.gemini.blueprint.context.support.AbstractDelegatedExecutionApplicationContext.access$1600(AbstractDelegatedExecutionApplicationContext.java:60)
      2016-02-16 15:27:24.588063500 	at org.eclipse.gemini.blueprint.context.support.AbstractDelegatedExecutionApplicationContext$4.run(AbstractDelegatedExecutionApplicationContext.java:325)
      2016-02-16 15:27:24.588069500 	at org.eclipse.gemini.blueprint.util.internal.PrivilegedUtils.executeWithCustomTCCL(PrivilegedUtils.java:85)
      2016-02-16 15:27:24.588070500 	at org.eclipse.gemini.blueprint.context.support.AbstractDelegatedExecutionApplicationContext.completeRefresh(AbstractDelegatedExecutionApplicationContext.java:290)
      2016-02-16 15:27:24.588071500 	at org.eclipse.gemini.blueprint.extender.internal.dependencies.startup.DependencyWaiterApplicationContextExecutor$CompleteRefreshTask.run(DependencyWaiterApplicationContextExecutor.java:137)
      2016-02-16 15:27:24.588079500 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      2016-02-16 15:27:24.588080500 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      2016-02-16 15:27:24.588080500 	at java.lang.Thread.run(Thread.java:745)
      2016-02-16 15:27:24.588081500 Caused by: org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'defaultTransitionFailureService': Unsatisfied dependency expressed through constructor argument with index 0 of type [com.atlassian.pocketknife.api.querydsl.DatabaseAccessor]: : Error creating bean with name 'databaseAccessorImpl': Unsatisfied dependency expressed through constructor argument with index 0 of type [com.atlassian.pocketknife.api.querydsl.DatabaseConnectionConverter]: : Error creating bean with name 'databaseConnectionConverterImpl': Unsatisfied dependency expressed through constructor argument with index 0 of type [com.atlassian.pocketknife.api.querydsl.schema.DialectProvider]: : Error creating bean with name 'defaultDialectConfiguration': Bean instantiation via constructor failed; nested exception is java.lang.OutOfMemoryError: Metaspace; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'defaultDialectConfiguration': Bean instantiation via constructor failed; nested exception is java.lang.OutOfMemoryError: Metaspace; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'databaseConnectionConverterImpl': Unsatisfied dependency expressed through constructor argument with index 0 of type [com.atlassian.pocketknife.api.querydsl.schema.DialectProvider]: : Error creating bean with name 'defaultDialectConfiguration': Bean instantiation via constructor failed; nested exception is java.lang.OutOfMemoryError: Metaspace; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'defaultDialectConfiguration': Bean instantiation via constructor failed; nested exception is java.lang.OutOfMemoryError: Metaspace; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'databaseAccessorImpl': Unsatisfied dependency expressed through constructor argument with index 0 of type [com.atlassian.pocketknife.api.querydsl.DatabaseConnectionConverter]: : Error creating bean with name 'databaseConnectionConverterImpl': Unsatisfied dependency expressed through constructor argument with index 0 of type [com.atlassian.pocketknife.api.querydsl.schema.DialectProvider]: : Error creating bean with name 'defaultDialectConfiguration': Bean instantiation via constructor failed; nested exception is java.lang.OutOfMemoryError: Metaspace; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'defaultDialectConfiguration': Bean instantiation via constructor failed; nested exception is java.lang.OutOfMemoryError: Metaspace; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'databaseConnectionConverterImpl': Unsatisfied dependency expressed through constructor argument with index 0 of type [com.atlassian.pocketknife.api.querydsl.schema.DialectProvider]: : Error creating bean with name 'defaultDialectConfiguration': Bean instantiation via constructor failed; nested exception is java.lang.OutOfMemoryError: Metaspace; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'defaultDialectConfiguration': Bean instantiation via constructor failed; nested exception is java.lang.OutOfMemoryError: Metaspace
      2016-02-16 15:27:24.588135500 	at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:749)
      2016-02-16 15:27:24.588136500 	at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:185)
      2016-02-16 15:27:24.588137500 	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1139)
      2016-02-16 15:27:24.588138500 	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1042)
      2016-02-16 15:27:24.588143500 	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:504)
      2016-02-16 15:27:24.588144500 	at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:303)
      2016-02-16 15:27:24.588145500 	at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
      2016-02-16 15:27:24.588149500 	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:299)
      2016-02-16 15:27:24.588155500 	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:194)
      2016-02-16 15:27:24.588156500 	at org.springframework.beans.factory.support.DefaultListableBeanFactory.findAutowireCandidates(DefaultListableBeanFactory.java:1120)
      2016-02-16 15:27:24.588157500 	at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1044)
      2016-02-16 15:27:24.588161500 	at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:942)
      2016-02-16 15:27:24.588162500 	at org.springframework.beans.factory.support.ConstructorResolver.resolveAutowiredArgument(ConstructorResolver.java:813)
      2016-02-16 15:27:24.588163500 	at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:741)
      2016-02-16 15:27:24.588168500 	... 19 more
      2016-02-16 15:27:24.588168500 Caused by: org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'databaseAccessorImpl': Unsatisfied dependency expressed through constructor argument with index 0 of type [com.atlassian.pocketknife.api.querydsl.DatabaseConnectionConverter]: : Error creating bean with name 'databaseConnectionConverterImpl': Unsatisfied dependency expressed through constructor argument with index 0 of type [com.atlassian.pocketknife.api.querydsl.schema.DialectProvider]: : Error creating bean with name 'defaultDialectConfiguration': Bean instantiation via constructor failed; nested exception is java.lang.OutOfMemoryError: Metaspace; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'defaultDialectConfiguration': Bean instantiation via constructor failed; nested exception is java.lang.OutOfMemoryError: Metaspace; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'databaseConnectionConverterImpl': Unsatisfied dependency expressed through constructor argument with index 0 of type [com.atlassian.pocketknife.api.querydsl.schema.DialectProvider]: : Error creating bean with name 'defaultDialectConfiguration': Bean instantiation via constructor failed; nested exception is java.lang.OutOfMemoryError: Metaspace; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'defaultDialectConfiguration': Bean instantiation via constructor failed; nested exception is java.lang.OutOfMemoryError: Metaspace
      2016-02-16 15:27:24.588191500 	at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:749)
      2016-02-16 15:27:24.588192500 	at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:185)
      2016-02-16 15:27:24.588196500 	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1139)
      2016-02-16 15:27:24.588197500 	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1042)
      2016-02-16 15:27:24.588198500 	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:504)
      2016-02-16 15:27:24.588205500 	at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:303)
      2016-02-16 15:27:24.588211500 	at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
      2016-02-16 15:27:24.588212500 	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:299)
      2016-02-16 15:27:24.588213500 	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:194)
      2016-02-16 15:27:24.588217500 	at org.springframework.beans.factory.support.DefaultListableBeanFactory.findAutowireCandidates(DefaultListableBeanFactory.java:1120)
      2016-02-16 15:27:24.588218500 	at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1044)
      2016-02-16 15:27:24.588219500 	at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:942)
      2016-02-16 15:27:24.588223500 	at org.springframework.beans.factory.support.ConstructorResolver.resolveAutowiredArgument(ConstructorResolver.java:813)
      2016-02-16 15:27:24.588224500 	at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:741)
      2016-02-16 15:27:24.588230500 	... 33 more
      2016-02-16 15:27:24.588230500 Caused by: org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'databaseConnectionConverterImpl': Unsatisfied dependency expressed through constructor argument with index 0 of type [com.atlassian.pocketknife.api.querydsl.schema.DialectProvider]: : Error creating bean with name 'defaultDialectConfiguration': Bean instantiation via constructor failed; nested exception is java.lang.OutOfMemoryError: Metaspace; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'defaultDialectConfiguration': Bean instantiation via constructor failed; nested exception is java.lang.OutOfMemoryError: Metaspace
      2016-02-16 15:27:24.588241500 	at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:749)
      2016-02-16 15:27:24.588242500 	at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:185)
      2016-02-16 15:27:24.588243500 	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1139)
      2016-02-16 15:27:24.588249500 	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1042)
      2016-02-16 15:27:24.588250500 	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:504)
      2016-02-16 15:27:24.588250500 	at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:303)
      2016-02-16 15:27:24.588257500 	at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
      2016-02-16 15:27:24.588258500 	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:299)
      2016-02-16 15:27:24.588258500 	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:194)
      2016-02-16 15:27:24.588263500 	at org.springframework.beans.factory.support.DefaultListableBeanFactory.findAutowireCandidates(DefaultListableBeanFactory.java:1120)
      2016-02-16 15:27:24.588264500 	at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1044)
      2016-02-16 15:27:24.588273500 	at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:942)
      2016-02-16 15:27:24.588274500 	at org.springframework.beans.factory.support.ConstructorResolver.resolveAutowiredArgument(ConstructorResolver.java:813)
      2016-02-16 15:27:24.588274500 	at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:741)
      2016-02-16 15:27:24.588279500 	... 47 more
      
      
      ... truncated to fit. all log attached ...
      
      
      2016-02-16 15:28:08.843956500 Uploaded to: s3://heapdumps-sc2-dev/2016-02-16/04/jra-59605.jira-dev.com-jira-16174-201602161527.tgz
      2016-02-16 15:28:08.857467500 OOME info can be accessed in S3 here: s3://heapdumps-sc2-dev/2016-02-16/04/jra-59605.jira-dev.com-jira-16174-201602161527.tgz
      2016-02-16 15:28:08.860393500 `/data/jirastudio/service/debug/jira/jra-59605.jira-dev.com-jira-16174-201602161527/jra-59605.jira-dev.com-jira-16174-201602161527.tgz' -> `/data/jirastudio/service/debug/jira/latest_oome_diagnostics.tgz'
      2016-02-16 15:28:08.860901500 ***** DEVELOPER: Your OOME diagnostics (including heap dump /data/jirastudio/service/debug/jira/java_pid16174.hprof) are here: /data/jirastudio/service/debug/jira/latest_oome_diagnostics.tgz *****
      2016-02-16 15:28:09.374076500   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
      2016-02-16 15:28:09.374575500                                  Dload  Upload   Total   Spent    Left  Speed
      100   707  100   707    0     0   1393      0 --:--:-- --:--:-- --:--:--     0
      2016-02-16 15:28:09.377469500 {
      2016-02-16 15:28:09.377469500   "data": [],
      2016-02-16 15:28:09.377469500   "message": "Failed to send: {u'status': 2, 'uuid': 'c453b206-b433-4f35-bb97-28b1ea2393d9', 'source': 'receiver', u'timestamp': 1455596888000, u'hostname': u'jra-59605.jira-dev.com', 'user_data': {u'product': u'jira', u'subject': u'jira on jra-59605.jira-dev.com is OOME'}, u'alert_string': u'***** OOME Script ***** jira on jra-59605.jira-dev.com is OOME.  Data Payload Location: s3=s3://heapdumps-sc2-dev/2016-02-16/04/jra-59605.jira-dev.com-jira-16174-201602161527.tgz ', u'platform': u'ondemand', 'received_timestamp': 1455596889364, u'location': u'sc2', 'service_name': u'jira oome'} (OOM command not allowed when used memory > 'maxmemory'.)",
      2016-02-16 15:28:09.377494500   "meta": null,
      2016-02-16 15:28:09.377494500   "status_code": 500
      2016-02-16 15:28:09.377495500 }Restarting jira (pid: 16174)...
      2016-02-16 15:28:09.564427500 removed `/data/jirastudio/service/debug/jira/jra-59605.jira-dev.com-jira-16174-201602161527/current'
      2016-02-16 15:28:09.564428500 removed `/data/jirastudio/service/debug/jira/jra-59605.jira-dev.com-jira-16174-201602161527/java_pid16174.hprof'
      2016-02-16 15:28:09.564429500 removed `/data/jirastudio/service/debug/jira/jra-59605.jira-dev.com-jira-16174-201602161527/current.150.log'
      2016-02-16 15:28:09.564429500 removed `/data/jirastudio/service/debug/jira/jra-59605.jira-dev.com-jira-16174-201602161527/access_log'
      2016-02-16 15:28:09.564459500 removed `/data/jirastudio/service/debug/jira/jra-59605.jira-dev.com-jira-16174-201602161527/error_log'
      2016-02-16 15:28:09.564460500 removed directory: `/data/jirastudio/service/debug/jira/jra-59605.jira-dev.com-jira-16174-201602161527'
      2016-02-16 15:28:09.626227500 WARN: Empty value for property /data/jirastudio/jira/service/java_opts/XX:+HeapDumpOnOutOfMemoryError=
      2016-02-16 15:28:09.627522500 WARN: Empty value for property /data/jirastudio/jira/service/java_opts/XX:+UseCodeCacheFlushing=
      2016-02-16 15:28:09.628683500 WARN: Empty value for property /data/jirastudio/jira/service/java_opts/XX:+UseSerialGC=
      2016-02-16 15:28:09.629820500 WARN: Empty value for property /data/jirastudio/jira/service/java_opts/XX:-OmitStackTraceInFastThrow=
      2016-02-16 15:28:09.769270500 Java HotSpot(TM) Server VM warning: ignoring option MaxPermSize=320m; support was removed in 8.0
      2016-02-16 15:28:10.436790500 Feb 16, 2016 3:28:10 PM org.apache.coyote.AbstractProtocol init
      2016-02-16 15:28:10.436792500 INFO: Initializing ProtocolHandler ["http-nio-2990"]
      2016-02-16 15:28:10.458270500 Feb 16, 2016 3:28:10 PM org.apache.tomcat.util.net.NioSelectorPool getSharedSelector
      2016-02-16 15:28:10.458272500 INFO: Using a shared selector for servlet write/read
      2016-02-16 15:28:10.464110500 Feb 16, 2016 3:28:10 PM org.apache.coyote.AbstractProtocol init
      2016-02-16 15:28:10.464111500 INFO: Initializing ProtocolHandler ["http-nio-127.127.127.127-12990"]
      2016-02-16 15:28:10.464112500 Feb 16, 2016 3:28:10 PM org.apache.tomcat.util.net.NioSelectorPool getSharedSelector
      2016-02-16 15:28:10.464112500 INFO: Using a shared selector for servlet write/read
      2016-02-16 15:28:10.466278500 Feb 16, 2016 3:28:10 PM org.apache.catalina.startup.Catalina load
      2016-02-16 15:28:10.466279500 INFO: Initialization processed in 513 ms
      2016-02-16 15:28:10.491096500 Feb 16, 2016 3:28:10 PM org.apache.catalina.core.StandardService startInternal
      2016-02-16 15:28:10.491097500 INFO: Starting service Catalina
      2016-02-16 15:28:10.492085500 Feb 16, 2016 3:28:10 PM org.apache.catalina.core.StandardEngine startInternal
      2016-02-16 15:28:10.492086500 INFO: Starting Servlet Engine: Apache Tomcat/8.0.20
      2016-02-16 15:28:10.523310500 Feb 16, 2016 3:28:10 PM org.apache.catalina.startup.HostConfig deployDescriptor
      2016-02-16 15:28:10.523312500 INFO: Deploying configuration descriptor /data/jirastudio/jira/service/catalina-base/conf/Catalina/localhost/ROOT.xml
      2016-02-16 15:28:10.561107500 Feb 16, 2016 3:28:10 PM org.apache.catalina.core.StandardContext setPath
      2016-02-16 15:28:10.561109500 WARNING: A context path must either be an empty string or start with a '/' and do not end with a '/'. The path [/] does not meet these criteria and has been changed to []
      2016-02-16 15:28:13.900103500 2016-02-16 15:28:13,898 localhost-startStop-1 INFO      [c.a.jira.startup.JiraStartupLogger]
      2016-02-16 15:28:13.900104500
      2016-02-16 15:28:13.900104500     ****************
      2016-02-16 15:28:13.900104500     JIRA starting...
      2016-02-16 15:28:13.900105500     ****************

      The User Management is locked.

      Notes

      Problem still shows with 1024MB of max_heap. (Problem is due to Metaspace but pointing this out as JIRA Cloud is automatically assigned more max_heap on each OOME.)
      A third import will work because the OOME restarts JIRA.

      Workaround

      Contact Cloud Support at https://support.atlassian.com to Restart the site after the first import or if the site is locked

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              mfernandezbadii Mauro Badii
              Votes:
              1 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: