Uploaded image for project: 'Bitbucket Cloud'
  1. Bitbucket Cloud
  2. BCLOUD-14601

Improve robots.txt on public repos for web crawlers

    XMLWordPrintable

    Details

    • Feedback Policy:

      Our product teams collect and evaluate feedback from a number of different sources. To learn more about how we use customer feedback in the planning process, check out our new feature policy.

      Description

      Sites like Github have a policy to include files/directories of the master branch on public repos for webcrawlers. We would need to change our robots.txt policy to include this on our site too.

        Attachments

          Activity

            People

            Assignee:
            Unassigned
            Reporter:
            jyowell Jesse Yowell (Inactive)
            Votes:
            1 Vote for this issue
            Watchers:
            2 Start watching this issue

              Dates

              Created:
              Updated: