Uploaded image for project: 'Confluence Data Center'
  1. Confluence Data Center
  2. CONFSERVER-13004

Attachment directory needs to be hashed to avoid filesystem limitations

XMLWordPrintable

    • We collect Confluence feedback from various sources, and we evaluate what we've collected when planning our product roadmap. To understand how this piece of feedback will be reviewed, see our Implementation of New Features Policy.

      Confluence stores all attachments in a as subdirectories the data/attachments folder, the name of the subdirectory is the page id. This is bad for the following reasons:

      • On linux few filesystems can handle directories with more than 2^15 sub directories. Once that limit is reached, new directories will fail to be created. The limit for ext3, the default file system for common linux distros is 31998 directory entries. More esoteric filesystems may raise this limit (please, not filesystem wars, ext2/3 is the most common filesystem) but it is still not a practice to be emulated.
      • Traversing a directory this size slows file access and most tools are not designed to handle directories that large

      This will become an issue in confluence hosted very soon.

      The attachment directory should be hashed, similar to the way squid hashes its cache directory.

            [CONFSERVER-13004] Attachment directory needs to be hashed to avoid filesystem limitations

            Sen Geronimo made changes -
            Workflow Original: JAC Suggestion Workflow 4 [ 3569092 ] New: JAC Suggestion Workflow 3 [ 4333247 ]
            Katherine Yabut made changes -
            Workflow Original: JAC Suggestion Workflow 2 [ 3173683 ] New: JAC Suggestion Workflow 4 [ 3569092 ]
            Status Original: RESOLVED [ 5 ] New: Closed [ 6 ]
            Katherine Yabut made changes -
            Workflow Original: JAC Suggestion Workflow [ 3029171 ] New: JAC Suggestion Workflow 2 [ 3173683 ]
            Owen made changes -
            Workflow Original: Confluence Workflow - Public Facing v4 [ 2535628 ] New: JAC Suggestion Workflow [ 3029171 ]
            Rachel Lin (Inactive) made changes -
            Workflow Original: Confluence Workflow - Public Facing v3 [ 2298518 ] New: Confluence Workflow - Public Facing v4 [ 2535628 ]
            Katherine Yabut made changes -
            Workflow Original: Confluence Workflow - Public Facing v3 - TEMP [ 2194507 ] New: Confluence Workflow - Public Facing v3 [ 2298518 ]
            Katherine Yabut made changes -
            Workflow Original: Confluence Workflow - Public Facing v3 [ 1919320 ] New: Confluence Workflow - Public Facing v3 - TEMP [ 2194507 ]
            Katherine Yabut made changes -
            Workflow Original: Confluence Workflow - Public Facing v2 [ 1752852 ] New: Confluence Workflow - Public Facing v3 [ 1919320 ]
            Katherine Yabut made changes -
            Workflow Original: CONF Suggestion WF (TEMP) [ 1677806 ] New: Confluence Workflow - Public Facing v2 [ 1752852 ]
            Katherine Yabut made changes -
            Workflow Original: Confluence Workflow - Public Facing [ 1376434 ] New: CONF Suggestion WF (TEMP) [ 1677806 ]

              pcurren Paul Curren
              dcheney David Cheney (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

                Created:
                Updated:
                Resolved: