Uploaded image for project: 'Jira Data Center'
  1. Jira Data Center
  2. JRASERVER-20102

Performance for CSV importer - make indexing configurable

This issue is archived. You can view it, but you can't modify it. Learn more

    XMLWordPrintable

Details

    Description

      Importing lots (10,000 or more?) can take days.

      Proposed solution:
      Reindexing seems to be a big part of the problem. It'd be nice to make the reindex interval be configurable from jira.properties rather than hard-coded:

      From com.atlassian.jira.imports.importer.impl.ImportSettings:

      private int maxIssuePerReindex = 50;
      

      From DefaultJiraDataImporter:

      ...
          private void importIssues(final ExternalProject externalProject)
         {
      ...
       // Reindex if required
                  if (unindexedIssueGvs.size() >= settings.getMaxIssuePerReindex())
                  {
                      ImportUtils.setIndexIssues(true);
                      reindexIssues();
                      ImportUtils.setIndexIssues(false);
                  }
      ...
          private void reindexIssues()
          {
              try
              {
                  log.newLine();
                  log.log("Reindexing last " + unindexedIssueGvs.size() + " issues imported ...");
                  final long l = ManagerFactory.getIndexManager().reIndexIssues(unindexedIssueGvs);
                  log.log("Reindexing took  " + l + "ms.");
      
                  log.newLine();
      
                  unindexedIssueGvs.clear();
              }
              catch (final IndexException e)
              {
                  log.fail("Reindexing failed", e);
              }
          }
      

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              jlargman Jeremy Largman
              Archiver:
              mandreacchio Michael Andreacchio

              Dates

                Created:
                Updated:
                Resolved:
                Archived: