[AI-358] Content indexing is very slow in Confluence using MySQL 5.5

Type: Bug
Resolution: Fixed
Priority: High
Component/s: Search - Core (DO NOT USE)
Labels:

Symptom Severity:
Severity 3 - Minor

NOTE: This bug report is for Confluence Cloud. Using Confluence Server? See the corresponding bug report.

Summary

When running Confluence on MySQL 5.5.x, content indexing takes a significant amount of time compared to when running on MySQL 5.6.x

After running the same 5.5.46 database with the same driver on Confluence 5.8.15, the reindex takes about 5 seconds with the same amount of content.

Environment

Confluence 5.9.1-OD-2015.39.1-0001
MySQL 5.5.46

Steps to Reproduce

Stand up a Confluence 5.9.1-OD-2015.39.1-0001 instance
Fill it with content
Reindex (from scratch or otherwise)

Expected Results

In a Confluence 5.9.1-OD-2015.39.1-0001 instance running on MySQL 5.6, indexing from scratch takes about 3 seconds.

Actual Results

With this same amount of content (restored from backup) running on MySQL 5.5 the indexing is at 50% after 10 minutes. Each page can take anywhere from 10 seconds to a minute to be indexed.

We can see multiple threads waiting to run an indexing task:

"confluence-interactive-reindexing-thread" #312 daemon prio=5 os_prio=0 tid=0x00007fb2d4199000 nid=0x7cee waiting on condition [0x00007fb24a669000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000000b8085f18> (a java.util.concurrent.FutureTask)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.FutureTask.awaitDone(FutureTask.java:429)
	at java.util.concurrent.FutureTask.get(FutureTask.java:191)
	at com.atlassian.confluence.index.ConfluenceReIndexer.indexHandles(ConfluenceReIndexer.java:245)
	at com.atlassian.confluence.index.ConfluenceReIndexer.lambda$indexType$505(ConfluenceReIndexer.java:205)
	at com.atlassian.confluence.index.ConfluenceReIndexer$$Lambda$324/610274474.perform(Unknown Source)
	at com.atlassian.bonnie.LuceneConnection.withWriter(LuceneConnection.java:489)
	at com.atlassian.confluence.index.ConfluenceReIndexer.indexType(ConfluenceReIndexer.java:197)
	at com.atlassian.confluence.index.ConfluenceReIndexer.indexAttachments(ConfluenceReIndexer.java:182)
	at com.atlassian.confluence.index.ConfluenceReIndexer.reIndex(ConfluenceReIndexer.java:128)
	at com.atlassian.confluence.search.ReIndexTask.run(ReIndexTask.java:43)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at com.atlassian.confluence.tenant.TenantGate$3.call(TenantGate.java:164)
	at com.atlassian.confluence.search.lucene.DefaultConfluenceIndexManager.lambda$reIndex$390(DefaultConfluenceIndexManager.java:256)
	at com.atlassian.confluence.search.lucene.DefaultConfluenceIndexManager$$Lambda$210/1075520606.run(Unknown Source)
	at java.lang.Thread.run(Thread.java:745)

Workaround

Upgrade MySQL to 5.6

is related to

CONFSERVER-39746 Content indexing is very slow in Confluence using MySQL 5.5

Closed

pqz made changes - 10/Apr/2024 3:36 AM

Sprint

Original: The other 23% [ 4259 ]

pqz made changes - 10/Apr/2024 3:36 AM

Component/s	Original: Search - Core [ 46383 ]
Component/s		New: Search - Core [ 75296 ]
Fix Version/s	Original: 6.0.0-OD-2015.48 [ 67911 ]
Fix Version/s	Original: 5.9.1 [ 67850 ]
Key	Original: ~~CONFCLOUD-39746~~	New: ~~AI-358~~
Symptom Severity		New: Severity 3 - Minor [ 14432 ]
Affects Version/s	Original: 5.9.8 [ 67997 ]
Affects Version/s	Original: Confluence 5.9.1-EAP05112015V2 [ 67910 ]
Affects Version/s	Original: Confluence 5.9.1-OD-2015.39.1-0001 [ 67875 ]
Project	Original: Confluence Cloud [ 18513 ]	New: Atlassian Intelligence [ 23110 ]

Monique Khairuliana (Inactive) made changes - 22/Aug/2019 4:24 AM

Workflow	Original: Confluence Workflow - Public Facing - Restricted v5 - TEMP [ 2362998 ]	New: JAC Bug Workflow v3 [ 3428139 ]
Status	Original: Resolved [ 5 ]	New: Closed [ 6 ]

Katherine Yabut made changes - 22/Jun/2017 6:37 AM

Workflow

Original: Confluence Workflow - Public Facing - Restricted v5 [ 2236407 ]

New: Confluence Workflow - Public Facing - Restricted v5 - TEMP [ 2362998 ]

Katherine Yabut made changes - 31/May/2017 5:19 AM

Workflow

Original: Confluence Workflow - Public Facing - Restricted v5.1 - TEMP [ 2200490 ]

New: Confluence Workflow - Public Facing - Restricted v5 [ 2236407 ]

Katherine Yabut made changes - 31/May/2017 4:46 AM

Workflow

Original: Confluence Workflow - Public Facing - Restricted v5 - TEMP [ 2140925 ]

New: Confluence Workflow - Public Facing - Restricted v5.1 - TEMP [ 2200490 ]

Katherine Yabut made changes - 31/May/2017 1:47 AM

Workflow

Original: Confluence Workflow - Public Facing - Restricted v5 [ 1895761 ]

New: Confluence Workflow - Public Facing - Restricted v5 - TEMP [ 2140925 ]

Katherine Yabut made changes - 03/Apr/2017 3:47 AM

Workflow

Original: Confluence Workflow - Public Facing - Restricted v3 [ 1821753 ]

New: Confluence Workflow - Public Facing - Restricted v5 [ 1895761 ]

jonah (Inactive) made changes - 02/Apr/2017 8:49 AM

Description

Original: h3. Summary
When running Confluence on MySQL 5.5.x, content indexing takes a significant amount of time compared to when running on MySQL 5.6.x

After running the same 5.5.46 database with the same driver on Confluence 5.8.15, the reindex takes about 5 seconds with the same amount of content.

h3. Environment
* Confluence 5.9.1-OD-2015.39.1-0001
* MySQL 5.5.46

h3. Steps to Reproduce
# Stand up a Confluence 5.9.1-OD-2015.39.1-0001 instance
# Fill it with content
# Reindex (from scratch or otherwise)

h3. Expected Results
In a Confluence 5.9.1-OD-2015.39.1-0001 instance running on MySQL 5.6, indexing from scratch takes about 3 seconds.

h3. Actual Results
With this same amount of content (restored from backup) running on MySQL 5.5 the indexing is at 50% after 10 minutes. Each page can take anywhere from 10 seconds to a minute to be indexed.

We can see multiple threads waiting to run an indexing task:
{noformat}
"confluence-interactive-reindexing-thread" #312 daemon prio=5 os_prio=0 tid=0x00007fb2d4199000 nid=0x7cee waiting on condition [0x00007fb24a669000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000000b8085f18> (a java.util.concurrent.FutureTask)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.FutureTask.awaitDone(FutureTask.java:429)
at java.util.concurrent.FutureTask.get(FutureTask.java:191)
at com.atlassian.confluence.index.ConfluenceReIndexer.indexHandles(ConfluenceReIndexer.java:245)
at com.atlassian.confluence.index.ConfluenceReIndexer.lambda$indexType$505(ConfluenceReIndexer.java:205)
at com.atlassian.confluence.index.ConfluenceReIndexer$$Lambda$324/610274474.perform(Unknown Source)
at com.atlassian.bonnie.LuceneConnection.withWriter(LuceneConnection.java:489)
at com.atlassian.confluence.index.ConfluenceReIndexer.indexType(ConfluenceReIndexer.java:197)
at com.atlassian.confluence.index.ConfluenceReIndexer.indexAttachments(ConfluenceReIndexer.java:182)
at com.atlassian.confluence.index.ConfluenceReIndexer.reIndex(ConfluenceReIndexer.java:128)
at com.atlassian.confluence.search.ReIndexTask.run(ReIndexTask.java:43)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at com.atlassian.confluence.tenant.TenantGate$3.call(TenantGate.java:164)
at com.atlassian.confluence.search.lucene.DefaultConfluenceIndexManager.lambda$reIndex$390(DefaultConfluenceIndexManager.java:256)
at com.atlassian.confluence.search.lucene.DefaultConfluenceIndexManager$$Lambda$210/1075520606.run(Unknown Source)
at java.lang.Thread.run(Thread.java:745)
{noformat}

h3.Workaround
Upgrade MySQL to 5.6

New: {panel:bgColor=#e7f4fa}
  *NOTE:* This bug report is for *Confluence Cloud*. Using *Confluence Server*? [See the corresponding bug report|http://jira.atlassian.com/browse/CONFSERVER-39746].
  {panel}

h3. Summary
When running Confluence on MySQL 5.5.x, content indexing takes a significant amount of time compared to when running on MySQL 5.6.x

After running the same 5.5.46 database with the same driver on Confluence 5.8.15, the reindex takes about 5 seconds with the same amount of content.

h3. Environment
* Confluence 5.9.1-OD-2015.39.1-0001
* MySQL 5.5.46

h3. Steps to Reproduce
# Stand up a Confluence 5.9.1-OD-2015.39.1-0001 instance
# Fill it with content
# Reindex (from scratch or otherwise)

h3. Expected Results
In a Confluence 5.9.1-OD-2015.39.1-0001 instance running on MySQL 5.6, indexing from scratch takes about 3 seconds.

h3. Actual Results
With this same amount of content (restored from backup) running on MySQL 5.5 the indexing is at 50% after 10 minutes. Each page can take anywhere from 10 seconds to a minute to be indexed.

We can see multiple threads waiting to run an indexing task:
{noformat}
"confluence-interactive-reindexing-thread" #312 daemon prio=5 os_prio=0 tid=0x00007fb2d4199000 nid=0x7cee waiting on condition [0x00007fb24a669000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000000b8085f18> (a java.util.concurrent.FutureTask)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.FutureTask.awaitDone(FutureTask.java:429)
at java.util.concurrent.FutureTask.get(FutureTask.java:191)
at com.atlassian.confluence.index.ConfluenceReIndexer.indexHandles(ConfluenceReIndexer.java:245)
at com.atlassian.confluence.index.ConfluenceReIndexer.lambda$indexType$505(ConfluenceReIndexer.java:205)
at com.atlassian.confluence.index.ConfluenceReIndexer$$Lambda$324/610274474.perform(Unknown Source)
at com.atlassian.bonnie.LuceneConnection.withWriter(LuceneConnection.java:489)
at com.atlassian.confluence.index.ConfluenceReIndexer.indexType(ConfluenceReIndexer.java:197)
at com.atlassian.confluence.index.ConfluenceReIndexer.indexAttachments(ConfluenceReIndexer.java:182)
at com.atlassian.confluence.index.ConfluenceReIndexer.reIndex(ConfluenceReIndexer.java:128)
at com.atlassian.confluence.search.ReIndexTask.run(ReIndexTask.java:43)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at com.atlassian.confluence.tenant.TenantGate$3.call(TenantGate.java:164)
at com.atlassian.confluence.search.lucene.DefaultConfluenceIndexManager.lambda$reIndex$390(DefaultConfluenceIndexManager.java:256)
at com.atlassian.confluence.search.lucene.DefaultConfluenceIndexManager$$Lambda$210/1075520606.run(Unknown Source)
at java.lang.Thread.run(Thread.java:745)
{noformat}

h3.Workaround
Upgrade MySQL to 5.6

jonah (Inactive) made changes - 02/Apr/2017 8:49 AM

Link

New: This issue is related to ~~CONFSERVER-39746~~ [ ~~CONFSERVER-39746~~ ]

Assignee:: Shaun Esther (Inactive)

Reporter:: Daniel Ponzio

Affected customers:: 0 This affects my team

Watchers:: 17 Start watching this issue

Created:: 29/Oct/2015 11:43 PM

Updated:: 10/Apr/2024 3:36 AM

Resolved:: 18/Nov/2015 4:56 AM

Details

Description

Summary

Environment

Steps to Reproduce

Expected Results

Actual Results

Workaround

Attachments

Issue Links

Forms

Activity

People

Dates