Uploaded image for project: 'Atlassian Intelligence'
  1. Atlassian Intelligence
  2. AI-1179

Adding custom website with infinite looping URLs to Rovo should not cause Rovo to continuously index

XMLWordPrintable

    • 1

    • Our product teams collect and evaluate feedback from a number of different sources. To learn more about how we use customer feedback in the planning process, check out our new feature policy.

      Issue Summary

      When adding a custom website connector to Rovo, if the site contains a link that appends to the URL infinitely, Rovo will continue to index in a continuous loop

      https://support.atlassian.com/organization-administration/docs/connect-custom-website-to-rovo/

      Steps to Reproduce

      1. Create a website and add content to the site
      2. Add a link on one of the pages that links to the same page and appends some string to the page (such as /wiki/123/)

      Expected Results

      Rovo stops indexing the infinite looping URLs after a certain depth

      Actual Results

      Rovo continuously follows the URL, resulting in a (near) infinite loop and thousands of indexed objects  

       

      For example: https://testsite.atlassian.com/wiki/homepage/wiki/123/homepage/wiki/123/homepage/wiki/123/homepage/wiki/123/homepage/wiki/123/homepage/wiki/123

      Workaround

      Update the site to not include links to URLs that append infinitely

            [AI-1179] Adding custom website with infinite looping URLs to Rovo should not cause Rovo to continuously index

            Patricia Balik (Inactive) made changes -
            Assignee Original: Adam Johnson [ 02572282391a ] New: Patricia Balik [ a985e6289b7e ]
            SET Analytics Bot made changes -
            Support reference count New: 1
            Nick Messer created issue -

              a985e6289b7e Patricia Balik (Inactive)
              99b354671bde Nick Messer
              Votes:
              1 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated: