Big memory consumption on big instances caused by Lucene

XMLWordPrintable

    • Type: Bug
    • Resolution: Tracked Elsewhere
    • Priority: Low
    • None
    • Affects Version/s: 3.5.5
    • Component/s: None
    • None

      Starting from 3.1 Fisheye uses single Lucene index for all repositories known as cross-repository index. It was observed for 3.5.5 that Lucene causes OOME for large instance. Cross-repository index terms retained about 2GB of RAM and field caches kept 1GB for longs nd 0.5GB for ints.

      Potential solutions:

      • term index
      • field cache (for fields used in sort)
        • shave long to int for dTimeMillis and lastModified - reduces used size by 2 to save 0.5GB
        • dTimiesMillis and lastModified should be merged into one field - it would decrease number of field caches by 1. Potential quick win
        • reduce all used by RecencyBoostingQuery or sorting timestamp fields lastUpdateHours (changeset), lastModifiedHrs (path), lastModified (branch), dTimeMillis (changeset) to one field dTimeSecs and reduce its size to integer. It would give us reduction of memory used by FieldCache(s) to 1/6 (1.5GB -> 250MB)
        • do not sort if possible

              Assignee:
              Unassigned
              Reporter:
              Cezary Zawadka
              Votes:
              1 Vote for this issue
              Watchers:
              4 Start watching this issue

                Created:
                Updated:
                Resolved: