Uploaded image for project: 'Confluence Data Center'
  1. Confluence Data Center
  2. CONFSERVER-12319

Adding users to a large group is slow with default (Hibernate) user management

XMLWordPrintable

      While debugging an outage at wikis.sun.com I noticed that the code in HibernateUserManager#addMembership generates some extremely inefficient queries that were giving our db and network hard time:

      membership = dGroup.getLocalMembers();

if (membership == null)
{
       membership = new HashSet();
       dGroup.setLocalMembers(membership);
}

membership.add(user);

      The last line of the code translates to:

      DEBUG 2008-07-02 11:35:43,801 [service-j2ee-3] BatcherImpl:log - select localmembe0_.groupid as groupid__, localmembe0_.userid as userid__, defaulthib1_.id as id0_, defaulthib1_.name as name0_, defaulthib1_.password as password0_, defaulthib1_.email as email0_, defaulthib1_.created as created0_, defaulthib1_.fullname as fullname0_ from local_members localmembe0_ inner join users defaulthib1_ on localmembe0_.userid=defaulthib1_.id where localmembe0_.groupid=?

DEBUG 2008-07-02 11:35:43,806 [service-j2ee-3] BatcherImpl:log - insert into local_members (groupid, userid) values (?, ?)

      Which means retrieve*all* members of a given group and then insert the user to the db.

      If you run this query on our db with 25k users in a group, you run into some really big problems. By that I mean that the query can easily run several minutes and affect the overall db performance.

      The code should be rewritten so that the uniqueness constraint is checked by a SELECT and if no dupe is found the INSERT can follow, otherwise this code will never scale.

        1. search-3.37.zip
          73 kB

            [CONFSERVER-12319] Adding users to a large group is slow with default (Hibernate) user management

            Katherine Yabut made changes -
            Workflow Original: JAC Bug Workflow v3 [ 2896607 ] New: CONFSERVER Bug Workflow v4 [ 2989506 ]
            Owen made changes -
            Workflow Original: JAC Bug Workflow v2 [ 2787961 ] New: JAC Bug Workflow v3 [ 2896607 ]
            Status Original: Resolved [ 5 ] New: Closed [ 6 ]
            Owen made changes -
            Workflow Original: JAC Bug Workflow [ 2719765 ] New: JAC Bug Workflow v2 [ 2787961 ]
            Owen made changes -
            Workflow Original: Confluence Workflow - Public Facing - Restricted v5 - TEMP [ 2388882 ] New: JAC Bug Workflow [ 2719765 ]
            Katherine Yabut made changes -
            Workflow Original: Confluence Workflow - Public Facing - Restricted v5 [ 2265926 ] New: Confluence Workflow - Public Facing - Restricted v5 - TEMP [ 2388882 ]
            Katherine Yabut made changes -
            Workflow Original: Confluence Workflow - Public Facing - Restricted v5.1 - TEMP [ 2209455 ] New: Confluence Workflow - Public Facing - Restricted v5 [ 2265926 ]
            Katherine Yabut made changes -
            Workflow Original: Confluence Workflow - Public Facing - Restricted v5 - TEMP [ 2194394 ] New: Confluence Workflow - Public Facing - Restricted v5.1 - TEMP [ 2209455 ]
            Katherine Yabut made changes -
            Workflow Original: Confluence Workflow - Public Facing - Restricted v5 [ 1927660 ] New: Confluence Workflow - Public Facing - Restricted v5 - TEMP [ 2194394 ]
            Katherine Yabut made changes -
            Workflow Original: Confluence Workflow - Public Facing - Restricted v3 [ 1737363 ] New: Confluence Workflow - Public Facing - Restricted v5 [ 1927660 ]
            Katherine Yabut made changes -
            Workflow Original: CONF Bug Subtask WF (TEMP) [ 1697359 ] New: Confluence Workflow - Public Facing - Restricted v3 [ 1737363 ]

              alynch Andrew Lynch (Inactive)
              15d9a6950818 Igor Minar
              Affected customers:
              11 This affects my team
              Watchers:
              9 Start watching this issue

                Created:
                Updated:
                Resolved: