The scheduler's worker pool becomes exhausted, preventing triggered builds from being executed.

XMLWordPrintable

    • 1
    • Severity 2 - Major
    • 1

      Issue Summary

      Another instance of  

      com.atlassian.bamboo.plan.vcsRevision.cleanup.PlanVcsRevisionHistoryCleanupScheduler

      gets spawned without considering one(limited amount) is running. This jobs do not finish on time and get pilled up which exhaust the scheduled worker  pool and  prevents Bamboo executing any trigger build job.

      Steps to Reproduce

      N/a

      Expected Results

      • Check if job exists or limit instances of PlanVcsRevisionHistoryCleanupScheduler.
      • Ensure scheduled worker pool does not saturate.

      Actual Results

      Threaddumps :

      "scheduler_Worker-1" #44 prio=5 os_prio=0 cpu=222 elapsed=2222 tid=xxxx nid=xxxx runnable  [xxxx]
         java.lang.Thread.State: RUNNABLE
      	at java.net.SocketInputStream.socketRead0(java.base@11.0.25/Native Method)
      	at java.net.SocketInputStream.socketRead(java.base@11.0.25/SocketInputStream.java:115)
      	at java.net.SocketInputStream.read(java.base@11.0.25/SocketInputStream.java:168)
      	at java.net.Socket
      .........
       t org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649)
      	at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617)
      	at org.hibernate.query.internal.AbstractProducedQuery.uniqueResult(AbstractProducedQuery.java:1659)
      	at com.atlassian.bamboo.plan.vcsRevision.PlanVcsRevisionHistoryHibernateDao.cleanupUnusedEntriesForPlan(PlanVcsRevisionHistoryHibernateDao.java:154)
      	at com.atlassian.bamboo.plan.vcsRevision.PlanVcsRevisionHistoryManagerImpl.cleanupUnusedEntriesForPlan(PlanVcsRevisionHistoryManagerImpl.java:80)
      	at jdk.internal.reflect.GeneratedMethodAccessor1557.invoke(Unknown Source)
      	at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(java.base@11.0.25/DelegatingMethodAccessorImpl.java:43)
      	at java.lang.reflect.Method.invoke(java.base@11.0.25/Method.java:566)
      	at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344)
      	at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198)
      	at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
      	at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123)
      	at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388)
      	at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119)
      	at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
      	at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241)
      	at com.sun.proxy.$Proxy312.cleanupUnusedEntriesForPlan(Unknown Source)
      	at com.atlassian.bamboo.plan.vcsRevision.PlanVcsRevisionHistoryServiceImpl.lambda$cleanupUnusedEntriesForPlan$4(PlanVcsRevisionHistoryServiceImpl.java:54)
      	at com.atlassian.bamboo.plan.vcsRevision.PlanVcsRevisionHistoryServiceImpl$$Lambda$xx/xxxx.run(Unknown Source)
      	at io.atlassian.util.concurrent.ManagedLocks$ManagedLockImpl.withLock(ManagedLocks.java:302)
      	at com.atlassian.bamboo.plan.vcsRevision.PlanVcsRevisionHistoryServiceImpl.cleanupUnusedEntriesForPlan(PlanVcsRevisionHistoryServiceImpl.java:53)
      	at com.atlassian.bamboo.plan.vcsRevision.cleanup.PlanVcsRevisionHistoryCleanupScheduler$PlanVcsHistoryCleanupJob.execute(PlanVcsRevisionHistoryCleanupScheduler.java:86)
                      

      Workaround

      Instance restart required

            Assignee:
            Marcin Gardias
            Reporter:
            Alex
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated:
              Resolved: