Uploaded image for project: 'Migration Platform'
  1. Migration Platform
  2. MIG-1666

Confluence Cloud Migration Assistant plugin causes the MSSQL tempdb to fill

    XMLWordPrintable

Details

    • Bug
    • Resolution: Unresolved
    • Low
    • None
    • CCMA - 3.4.10, CCMA - 3.4.11, CCMA - 3.4.12, CCMA - 3.4.13
    • None
    • 2
    • Minor
    • 2

    Description

      Issue Summary

      This is reproducible on Data Center: YES

      Steps to Reproduce

      Could not reproduce it locally yet, but there are multiple reports about this behaviour. Working on this.

      Expected Results

      To run the CCMA plugin and work as expected.

      Actual Results

      It seems that the CCMA is triggered by the UPM when the users hit the plugins/servlet/upm endpoint. The below extract is shown in the atlassian-confluence-migration.log file:

      2023-09-12 13:05:25,961 INFO [ThreadPoolAsyncTaskExecutor::Thread 36] [store.jpa.impl.LiquibaseSchemaUpgrader] info starting Liquibase setup
       -- url: /rest/plugins/1.0/ | userName: CONFLUENCEADMIN | referer: https://CONFLUENCEURL:8443/plugins/servlet/upm | traceId: 0f28dffae35db6e5
      2023-09-12 13:05:28,459 INFO [ThreadPoolAsyncTaskExecutor::Thread 36] [store.jpa.impl.LiquibaseSchemaUpgrader] info Liquibase initialization completed
       -- url: /rest/plugins/1.0/ | userName: CONFLUENCEADMIN | referer: https://CONFLUENCEURL:8443/plugins/servlet/upm | traceId: 0f28dffae35db6e5
      2023-09-12 13:05:31,592 INFO [ThreadPoolAsyncTaskExecutor::Thread 36] [migration.agent.service.ClusterLimits] info Maximum node count will be periodically checked on the database every PT5M
       -- url: /rest/plugins/1.0/ | userName: CONFLUENCEADMIN | referer: https://CONFLUENCEURL:8443/plugins/servlet/upm | traceId: 0f28dffae35db6e5
      2023-09-12 13:05:31,671 INFO [ThreadPoolAsyncTaskExecutor::Thread 36] [agent.service.stepexecutor.ExportExecutor] info Created temporary directory for export, call return false
       -- url: /rest/plugins/1.0/ | userName: CONFLUENCEADMIN | referer: https://CONFLUENCEURL:8443/plugins/servlet/upm | traceId: 0f28dffae35db6e5
      2023-09-12 13:05:31,954 INFO [ThreadPoolAsyncTaskExecutor::Thread 36] [service.stepexecutor.attachment.AttachmentMigrationExecutor] info Initialized attachment migration executor with concurrency = 5 and batch size = 1000.
       -- url: /rest/plugins/1.0/ | userName: CONFLUENCEADMIN | referer: https://CONFLUENCEURL:8443/plugins/servlet/upm | traceId: 0f28dffae35db6e5
      2023-09-12 13:05:32,098 INFO [ThreadPoolAsyncTaskExecutor::Thread 36] [agent.service.stepexecutor.ExportExecutor] info Created temporary directory for export, call return false
       -- url: /rest/plugins/1.0/ | userName: CONFLUENCEADMIN | referer: https://CONFLUENCEURL:8443/plugins/servlet/upm | traceId: 0f28dffae35db6e5
      2023-09-12 13:05:32,125 INFO [ThreadPoolAsyncTaskExecutor::Thread 36] [migration.agent.queue.QueueBroker] info Started queue broker. Registered consumers: [com.atlassian.migration.agent.service.stepexecutor.globalentities.GlobalEntitiesExportExecutor@54ebe5f9, com.atlassian.migration.agent.service.stepexecutor.globalentities.GlobalEntitiesUploadExecutor@738502fe, com.atlassian.migration.agent.service.stepexecutor.globalentities.GlobalEntitiesImportExecutor@121c8f05, com.atlassian.migration.agent.service.stepexecutor.attachment.AttachmentMigrationExecutor@30f903b6, com.atlassian.migration.agent.service.stepexecutor.user.UsersMigrationExecutor@3b36fc7d, com.atlassian.migration.agent.service.stepexecutor.space.SpaceExportExecutor@60ff8b17, com.atlassian.migration.agent.service.stepexecutor.space.SpaceUsersMigrationExecutor@16ed54aa, com.atlassian.migration.agent.service.stepexecutor.space.SpaceImportExecutor@6e711172, com.atlassian.migration.agent.service.stepexecutor.space.SpaceUploadExecutor@62a8cdd5]
       -- url: /rest/plugins/1.0/ | userName: CONFLUENCEADMIN | referer: https://CONFLUENCEURL:8443/plugins/servlet/upm | traceId: 0f28dffae35db6e5
      2023-09-12 13:05:32,165 INFO [ThreadPoolAsyncTaskExecutor::Thread 36] [agent.service.analytics.AnalyticsEventConsumer] info Successfully registered AnalyticsEventConsumer job migration-plugin:analytics-events-consumer-runner-key.
       -- url: /rest/plugins/1.0/ | userName: CONFLUENCEADMIN | referer: https://CONFLUENCEURL:8443/plugins/servlet/upm | traceId: 0f28dffae35db6e5
      2023-09-12 13:05:32,166 INFO [ThreadPoolAsyncTaskExecutor::Thread 36] [agent.service.analytics.AnalyticsEventConsumer] info Successfully started AnalyticsEventConsumer poller.
       -- url: /rest/plugins/1.0/ | userName: CONFLUENCEADMIN | referer: https://CONFLUENCEURL:8443/plugins/servlet/upm | traceId: 0f28dffae35db6e5
      2023-09-12 13:05:32,189 INFO [ThreadPoolAsyncTaskExecutor::Thread 36] [agent.service.impl.SpaceStatisticCalculationInitialExecutor] init Successfully registered job with runnerKey: migration-plugin:initial-space-statistic-calculation
      2023-09-12 13:05:32,190 INFO [Caesium-1-2] [agent.service.impl.SpaceStatisticCalculationInitialExecutor] runJob Running initial space statistic calculation job. jobId: migration-plugin:initial-space-statistic-calculation
      2023-09-12 13:05:32,190 INFO [ThreadPoolAsyncTaskExecutor::Thread 36] [agent.service.impl.SpaceStatisticCalculationInitialExecutor] init Successfully scheduled job. jobId: migration-plugin:initial-space-statistic-calculation , runnerKey: migration-plugin:initial-space-statistic-calculation
      2023-09-12 13:05:32,197 INFO [Caesium-1-2] [agent.service.impl.SpaceStatisticCalculationService] runSpaceStatisticCalculationIfEmptyOrMissingSpaces Running 15 spaces without space statistics
      2023-09-12 13:05:32,197 INFO [Caesium-1-2] [agent.service.impl.SpaceStatisticCalculationService] spinupJobsToRunSpaceStaticCalculations submitting tasks
      2023-09-12 13:05:32,200 INFO [pool-77-thread-1] [agent.service.impl.SpaceStatisticCalculationService] calculateStatisticsFor Calculating space statistics for batch migration-plugin:initial-space-statistic-calculation-a7ceaecb-2b50-49b2-850a-674165fcd8b9-batch0
      2023-09-12 13:05:32,332 INFO [ThreadPoolAsyncTaskExecutor::Thread 36] [agent.service.impl.DetectedUserEmailAnalyticsScheduledRunner] postConstruct Scheduled detected email analytics event collection job to be run each 120 hours.
      2023-09-12 13:05:32,641 INFO [pool-77-thread-1] [agent.service.impl.SpaceStatisticCalculationService] storeStatistics Storing statistics for batch migration-plugin:initial-space-statistic-calculation-a7ceaecb-2b50-49b2-850a-674165fcd8b9-batch0
      2023-09-12 13:05:32,682 INFO [pool-77-thread-1] [agent.service.impl.SpaceStatisticCalculationService] calculateAndStore Took 482ms to calculate and store space statistic for batch migration-plugin:initial-space-statistic-calculation-a7ceaecb-2b50-49b2-850a-674165fcd8b9-batch0 with 15 spaces: 441ms to calculate and 41ms to store. 
      2023-09-12 13:05:32,689 INFO [Caesium-1-2] [agent.service.impl.SpaceStatisticCalculationService] spinupJobsToRunSpaceStaticCalculations took 492ms to finish job migration-plugin:initial-space-statistic-calculation
      2023-09-12 13:05:36,595 WARN [Caesium-1-3] [migration.agent.service.ClusterLimits] warn It is most likely Confluence does not have the permissions (in the previous) to read the CPU statistics, please add these and restart CCMA. Until restart, CCMA will no longer run the scheduled CPU query and it will be based upon system properties
      2023-09-12 13:05:42,095 INFO [Caesium-1-1] [service.stepexecutor.export.SpaceExportCacheService] removeExpiredCacheEntries Removing export cache entries that have exceeded their TTL.
      2023-09-12 13:05:42,323 INFO [Caesium-1-4] [agent.service.check.StaleChecksCleaner] info Cleaning stale checks
      2023-09-12 13:05:47,347 INFO [Caesium-1-3] [agent.service.impl.DetectedUserEmailAnalyticsScheduledRunner] runJob Trigger detected emails analytics events collection for all linked cloud ids.
      2023-09-12 13:05:47,393 INFO [Caesium-1-2] [agent.service.impl.DetectedUserEmailAnalyticsService] lambda$runJob$1 Start job to collect detected emails analytics events for cloud ids = [].
      2023-09-12 13:05:47,393 WARN [Caesium-1-2] [agent.service.impl.DetectedUserEmailAnalyticsService] collectAndSendEvents There are no cloud sites linked. Skip job.
       -- jobId: 03bb1213-a2b7-4621-b79e-2fc95fba0456 | jobRunnerId: migration-plugin:detected-emails-runner
      

      Then in the MSSQL TEMPDB space, the size increases filling it up. When checking the query that is causing this, a similar query to the following is found:

      <?query -- (@P0 int)select config0_.id as id1_20_0_, config0_.attachmentConcurrencyClusterMax as attachme2_20_0_, config0_.attachmentConcurrencyNodeMax as attachme3_20_0_, config0_.attachmentUploadConcurrency as attachme4_20_0_, config0_.exportConcurrencyClusterMax as exportco5_20_0_, config0_.exportConcurrencyNodeMax as exportco6_20_0_, config0_.importConcurrencyClusterMax as importco7_20_0_, config0_.importConcurrencyNodeMax as importco8_20_0_, config0_.lastUpdate as lastupda9_20_0_, config0_.uploadConcurrencyClusterMax as uploadc10_20_0_, config0_.uploadConcurrencyNodeMax as uploadc11_20_0_ from MIG_CONFIG config0_ where config0_.id=@P0 --?>

      That query is trying to get data from the MIG_CONFIG table, which is related to the CCMA (Confluence Cloud Migration Assistant) plugin:

      mig_* Entries and configurations for Confluence Cloud Migration Assistant app.

      Workaround

      Disabling the CCMA plugin prevents the query from causing this issue.

      Attachments

        Activity

          People

            Unassigned Unassigned
            a10ada9f39c1 betto
            Votes:
            10 Vote for this issue
            Watchers:
            11 Start watching this issue

            Dates

              Created:
              Updated: