Provisioning data to sites is very slow at scale

XMLWordPrintable

    • 74
    • Minor
    • Hide

      Update 17th Feb

      Hi everyone,

      Thanks for your patience on this ticket so far. I just wanted to provide a quick update on some of the planned changes to improve the performance of SCIM provisioning:

      • Short term (FY24Q4): an opt-in experience for customers with 500k+ writes (sum of users, groups, and memberships), with expected provisioning time improvements of up to 50%. This short term solution will be opt-in as it involves changes to some admin experiences.
      • Longer term (FY25H2): we are currently working on architectural changes that are expected to reduce provisioning time to 20% of what it is today. These changes will be available to all customers.

      In the meantime, if you’re expecting to sync a large number of groups (e.g. 10k+) via your IdP, I’d recommend starting your sync a week ahead to avoid any issues with delays in syncing. I acknowledge this is a suboptimal experience at the moment. We’re doing our best to make things better as soon as possible.

      I hope this information is helpful. If you have any questions about anything, please don’t hesitate to get in touch via this ticket.

      Cheers,
      Aneita
      Product Manager, Atlassian Access

      Show
      Update 17th Feb Hi everyone, Thanks for your patience on this ticket so far. I just wanted to provide a quick update on some of the planned changes to improve the performance of SCIM provisioning: Short term (FY24Q4): an opt-in experience for customers with 500k+ writes (sum of users, groups, and memberships), with expected provisioning time improvements of up to 50%. This short term solution will be opt-in as it involves changes to some admin experiences. Longer term (FY25H2): we are currently working on architectural changes that are expected to reduce provisioning time to 20% of what it is today. These changes will be available to all customers. In the meantime, if you’re expecting to sync a large number of groups (e.g. 10k+) via your IdP, I’d recommend starting your sync a week ahead to avoid any issues with delays in syncing. I acknowledge this is a suboptimal experience at the moment. We’re doing our best to make things better as soon as possible. I hope this information is helpful. If you have any questions about anything, please don’t hesitate to get in touch via this ticket. Cheers, Aneita Product Manager, Atlassian Access

      Issue Summary

      Propagating the provisioning data to the site can take days to complete when there is a huge amount of data.

      Steps to Reproduce

      Sync a large number of groups (e.g 10-30k) via provisioning or delete a provisioning directory with similar sized groups already synced.

      Expected Results

      Changes should reflect on the site within a reasonable amount of time.

      Actual Results

      Propagation time can take days without any progress status.
      New updates are set behind the propagation queue and so new access and permissions for users are also blocked.

      Workaround

      Currently there is no known workaround for this behavior. A workaround will be added here when available

        1. image-2024-02-16-14-33-24-362.png
          image-2024-02-16-14-33-24-362.png
          109 kB

            Assignee:
            FellowJitster
            Reporter:
            Ramon M (Inactive)
            Votes:
            40 Vote for this issue
            Watchers:
            74 Start watching this issue

              Created:
              Updated:
              Resolved: