Reindex is slow and takes several hours to complete

XMLWordPrintable

    • 18
    • Severity 1 - Critical
    • 23

      Summary

      When performing a migration to JIRA Cloud the site reindex that normally runs in 30 minutes is now taking hours to complete. JIRA is doing 1% reindex every 10-20 minutes.

      Note: The problem was originally found on imports but it is now found to be also affecting Background reindex.

      Environment

      • JIRA Cloud since v1000.610.2

      Steps to Reproduce

      1. Start a JIRA import

      Expected Results

      JIRA is imported and the reindex takes 30 minutes or less (depending on size of import)

      Actual Results

      The importer takes hours to complete the import

      # cat current-jira-log | grep Re-indexing
2016-12-10 21:20:05,325 IssueIndexer:thread-1 INFO Services-admin 1255x3440x1  81.138.90.49 /secure/admin/StudioImport!import.jspa [c.a.j.bc.dataimport.DefaultDataImportService] Re-indexing is 1% complete. Current index: Issue
2016-12-10 21:37:39,556 IssueIndexer:thread-10 INFO Services-admin 1255x3440x1  81.138.90.49 /secure/admin/StudioImport!import.jspa [c.a.j.bc.dataimport.DefaultDataImportService] Re-indexing is 2% complete. Current index: Issue
2016-12-10 21:55:46,325 IssueIndexer:thread-5 INFO Services-admin 1255x3440x1  81.138.90.49 /secure/admin/StudioImport!import.jspa [c.a.j.bc.dataimport.DefaultDataImportService] Re-indexing is 3% complete. Current index: Issue
2016-12-10 22:13:20,624 IssueIndexer:thread-8 INFO Services-admin 1255x3440x1  81.138.90.49 /secure/admin/StudioImport!import.jspa [c.a.j.bc.dataimport.DefaultDataImportService] Re-indexing is 4% complete. Current index: Issue
2016-12-10 22:30:55,314 IssueIndexer:thread-1 INFO Services-admin 1255x3440x1  81.138.90.49 /secure/admin/StudioImport!import.jspa [c.a.j.bc.dataimport.DefaultDataImportService] Re-indexing is 5% complete. Current index: Issue
2016-12-10 22:49:00,866 IssueIndexer:thread-3 INFO Services-admin 1255x3440x1  81.138.90.49 /secure/admin/StudioImport!import.jspa [c.a.j.bc.dataimport.DefaultDataImportService] Re-indexing is 6% complete. Current index: Issue
2016-12-10 23:06:35,545 IssueIndexer:thread-3 INFO Services-admin 1255x3440x1  81.138.90.49 /secure/admin/StudioImport!import.jspa [c.a.j.bc.dataimport.DefaultDataImportService] Re-indexing is 7% complete. Current index: Issue
2016-12-10 23:24:10,716 IssueIndexer:thread-8 INFO Services-admin 1255x3440x1  81.138.90.49 /secure/admin/StudioImport!import.jspa [c.a.j.bc.dataimport.DefaultDataImportService] Re-indexing is 8% complete. Current index: Issue
2016-12-10 23:42:15,803 IssueIndexer:thread-6 INFO Services-admin 1255x3440x1  81.138.90.49 /secure/admin/StudioImport!import.jspa [c.a.j.bc.dataimport.DefaultDataImportService] Re-indexing is 9% complete. Current index: Issue
2016-12-10 23:59:51,544 IssueIndexer:thread-4 INFO Services-admin 1255x3440x1  81.138.90.49 /secure/admin/StudioImport!import.jspa [c.a.j.bc.dataimport.DefaultDataImportService] Re-indexing is 10% complete. Current index: Issue
2016-12-11 00:17:27,029 IssueIndexer:thread-1 INFO Services-admin 1255x3440x1  81.138.90.49 /secure/admin/StudioImport!import.jspa [c.a.j.bc.dataimport.DefaultDataImportService] Re-indexing is 11% complete. Current index: Issue
2016-12-11 00:35:32,621 IssueIndexer:thread-4 INFO Services-admin 1255x3440x1  81.138.90.49 /secure/admin/StudioImport!import.jspa [c.a.j.bc.dataimport.DefaultDataImportService] Re-indexing is 12% complete. Current index: Issue
2016-12-11 00:53:07,251 IssueIndexer:thread-6 INFO Services-admin 1255x3440x1  81.138.90.49 /secure/admin/StudioImport!import.jspa [c.a.j.bc.dataimport.DefaultDataImportService] Re-indexing is 13% complete. Current index: Issue
2016-12-11 01:10:42,545 IssueIndexer:thread-1 INFO Services-admin 1255x3440x1  81.138.90.49 /secure/admin/StudioImport!import.jspa [c.a.j.bc.dataimport.DefaultDataImportService] Re-indexing is 14% complete. Current index: Issue
2016-12-11 01:28:47,952 IssueIndexer:thread-7 INFO Services-admin 1255x3440x1  81.138.90.49 /secure/admin/StudioImport!import.jspa [c.a.j.bc.dataimport.DefaultDataImportService] Re-indexing is 15% complete. Current index: Issue
2016-12-11 01:46:23,293 IssueIndexer:thread-4 INFO Services-admin 1255x3440x1  81.138.90.49 /secure/admin/StudioImport!import.jspa [c.a.j.bc.dataimport.DefaultDataImportService] Re-indexing is 16% complete. Current index: Issue
2016-12-11 02:03:59,351 IssueIndexer:thread-3 INFO Services-admin 1255x3440x1  81.138.90.49 /secure/admin/StudioImport!import.jspa [c.a.j.bc.dataimport.DefaultDataImportService] Re-indexing is 17% complete. Current index: Issue
2016-12-11 02:22:04,124 IssueIndexer:thread-6 INFO Services-admin 1255x3440x1  81.138.90.49 /secure/admin/StudioImport!import.jspa [c.a.j.bc.dataimport.DefaultDataImportService] Re-indexing is 18% complete. Current index: Issue
2016-12-11 02:39:41,905 IssueIndexer:thread-4 INFO Services-admin 1255x3440x1  81.138.90.49 /secure/admin/StudioImport!import.jspa [c.a.j.bc.dataimport.DefaultDataImportService] Re-indexing is 19% complete. Current index: Issue
2016-12-11 02:57:18,561 IssueIndexer:thread-10 INFO Services-admin 1255x3440x1  81.138.90.49 /secure/admin/StudioImport!import.jspa [c.a.j.bc.dataimport.DefaultDataImportService] Re-indexing is 20% complete. Current index: Issue
2016-12-11 03:15:23,154 IssueIndexer:thread-3 INFO Services-admin 1255x3440x1  81.138.90.49 /secure/admin/StudioImport!import.jspa [c.a.j.bc.dataimport.DefaultDataImportService] Re-indexing is 21% complete. Current index: Issue
2016-12-11 03:32:57,319 IssueIndexer:thread-2 INFO Services-admin 1255x3440x1  81.138.90.49 /secure/admin/StudioImport!import.jspa [c.a.j.bc.dataimport.DefaultDataImportService] Re-indexing is 22% complete. Current index: Issue
2016-12-11 03:50:32,937 IssueIndexer:thread-10 INFO Services-admin 1255x3440x1  81.138.90.49 /secure/admin/StudioImport!import.jspa [c.a.j.bc.dataimport.DefaultDataImportService] Re-indexing is 23% complete. Current index: Issue
2016-12-11 04:08:37,517 IssueIndexer:thread-6 INFO Services-admin 1255x3440x1  81.138.90.49 /secure/admin/StudioImport!import.jspa [c.a.j.bc.dataimport.DefaultDataImportService] Re-indexing is 24% complete. Current index: Issue
2016-12-11 04:26:13,301 IssueIndexer:thread-8 INFO Services-admin 1255x3440x1  81.138.90.49 /secure/admin/StudioImport!import.jspa [c.a.j.bc.dataimport.DefaultDataImportService] Re-indexing is 25% complete. Current index: Issue

      Notes

      Same result for JIRA imports with or without attachments

      Workaround

      The cause of this have been traced to applinks that are timing out during resolution. Before running any imports or reindexes look in the Application Links administration section for applinks that are unable to resolve and remove them. If importing from a server instance into a cloud instance remove any applinks that will not be able to resolve from a cloud instance (e.g. any firewalled resources) before performing the export. If you need assistance with this please contact the support team.

            Assignee:
            Unassigned
            Reporter:
            Mauro Badii (Inactive)
            Votes:
            5 Vote for this issue
            Watchers:
            24 Start watching this issue

              Created:
              Updated:
              Resolved: