Uploaded image for project: 'Confluence Data Center'
  1. Confluence Data Center
  2. CONFSERVER-57588

Multibyte characters don't get rendered when conversion sandbox enabled

      Issue Summary

      Multibyte characters don't get rendered when conversion sandbox enabled even when appropriate font is installed with the following steps.
      https://confluence.atlassian.com/confkb/non-ascii-characters-display-as-square-characters-in-confluence-317948797.html

      Environment

      • Confluence Data Center
      • document.conversion.sandbox.disable=false (same as default)
      • Multibyte font installed on the server
        • "4 fonts package" of Japanese IPA fonts (https://ipafont.ipa.go.jp/old/ipafont/download.html#en) installed in
          • /usr/share/fonts
          • /opt/atlassian/confluence/jre/lib/fonts/fallback
        • Following JVM argument is specified in setenv.sh
          CATALINA_OPTS="-Dconfluence.document.conversion.fontpath=/usr/share/fonts/ -Dconfluence.document.conversion.slides.defaultfontname.regular=IPAGothic -Dconfluence.document.conversion.slides.defaultfontname.asian=IPAGothic -Dconfluence.document.conversion.slides.defaultfontname.symbol=IPAGothic ${CATALINA_OPTS}"
          CATALINA_OPTS="-Dconfluence.document.conversion.words.defaultfontname=IPAGothic ${CATALINA_OPTS}"
          

      Steps to Reproduce

      1. Install Japanese fonts on the hosting server as described in above.
      2. Start a Confluence Data Center instance
      3. Attach テスト.pptx in an editor

      Expected Results

      "テストプレゼンテーション" is shown in thumbnail and preview.

      Actual Results

      Square characters are shown for thumbnail and preview.

      • Thumbnail
      • Preview

      Notes

      Characters are rendered correctly for some file type.
      As far as I confirmed in 6.12.2,

      file type thumbnail preview
      pptx
      docx
      xlsx
      txt

      Workaround

      Disable the conversion sandbox adding following option in setenv.sh. This is not recommended as it will affect the stability of the instance.

      CATALINA_OPTS="-Ddocument.conversion.sandbox.disable=true ${CATALINA_OPTS}"
      

      Solution

      Add the following to setenv.sh so that system settings are correctly propagated to the sandbox:

      CATALINA_OPTS="-Dconversion.sandbox.java.options=-Dconfluence.document.conversion.slides.defaultfontname.regular=IPAGothic,-Dconfluence.document.conversion.slides.defaultfontname.asian=IPAGothic,-Dconfluence.document.conversion.slides.defaultfontname.symbol=IPAGothic,-Dconfluence.document.conversion.words.defaultfontname=IPAGothic  ${CATALINA_OPTS}"
      

        1. Screen Shot 2018-11-29 at 18.11.04.png
          51 kB
          Nobuyuki Mukai
        2. Screen Shot 2018-11-29 at 18.11.21.png
          203 kB
          Nobuyuki Mukai
        3. テスト.pptx
          33 kB
          Nobuyuki Mukai

          Form Name

            [CONFSERVER-57588] Multibyte characters don't get rendered when conversion sandbox enabled

            Renata Dornelas made changes -
            Remote Link Original: This issue links to "Page (Atlassian Documentation)" [ 429504 ]
            Alex Blekhman (Inactive) made changes -
            Link New: This issue is related to CONFSERVER-58644 [ CONFSERVER-58644 ]
            Nobuyuki Mukai made changes -
            Remote Link New: This issue links to "Page (Atlassian Documentation)" [ 429504 ]
            Takuya Nagasaka (Inactive) made changes -
            Remote Link New: This issue links to "Page (Confluence)" [ 427809 ]
            Yuki Okamoto (Inactive) made changes -
            Remote Link New: This issue links to "Page (Confluence)" [ 415035 ]
            Usman Khalid (Inactive) made changes -
            Labels Original: enterprise-backlog i18n megalodon scale-team warranty New: i18n megalodon scale-team warranty
            Usman Khalid (Inactive) made changes -
            Labels Original: enterprise-backlog i18n megalodon warranty New: enterprise-backlog i18n megalodon scale-team warranty
            Mark Bereznitsky made changes -
            Resolution New: Answered [ 9 ]
            Status Original: Gathering Impact [ 12072 ] New: Closed [ 6 ]
            Mark Bereznitsky made changes -
            Description Original: h3. Issue Summary

            Multibyte characters don't get rendered when conversion sandbox enabled even when appropriate font is installed with the following steps.
             [https://confluence.atlassian.com/confkb/non-ascii-characters-display-as-square-characters-in-confluence-317948797.html]
            h3. Environment
             * Confluence Data Center
             * document.conversion.sandbox.disable=false (same as default)
             * Multibyte font installed on the server
             ** "4 fonts package" of Japanese IPA fonts ([https://ipafont.ipa.go.jp/old/ipafont/download.html#en]) installed in
             *** /usr/share/fonts
             *** /opt/atlassian/confluence/jre/lib/fonts/fallback
             ** Following JVM argument is specified in setenv.sh
            {code:none}
            CATALINA_OPTS="-Dconfluence.document.conversion.fontpath=/usr/share/fonts/ -Dconfluence.document.conversion.slides.defaultfontname.regular=IPAGothic -Dconfluence.document.conversion.slides.defaultfontname.asian=IPAGothic -Dconfluence.document.conversion.slides.defaultfontname.symbol=IPAGothic ${CATALINA_OPTS}"
            CATALINA_OPTS="-Dconfluence.document.conversion.words.defaultfontname=IPAGothic ${CATALINA_OPTS}"
            {code}

            h3. Steps to Reproduce
             # Install Japanese fonts on the hosting server as described in above.
             # Start a Confluence Data Center instance
             # Attach [^テスト.pptx] in an editor

            h3. Expected Results

            "テストプレゼンテーション" is shown in thumbnail and preview.
            h3. Actual Results

            Square characters are shown for thumbnail and preview.
             * Thumbnail
             !Screen Shot 2018-11-29 at 18.11.04.png|thumbnail!

             * Preview
             !Screen Shot 2018-11-29 at 18.11.21.png|thumbnail!

            h3. Notes

            Characters are rendered correctly for some file type.
             As far as I confirmed in 6.12.2,
            ||file type||thumbnail||preview||
            |pptx|(x)|(x)|
            |docx|(/)|(x)|
            |xlsx|(/)|(/)|
            |txt|(/)|(x)|
            h3. Workaround

            Disable the conversion sandbox adding following option in setenv.sh
            {code:java}
            CATALINA_OPTS="-Ddocument.conversion.sandbox.disable=true ${CATALINA_OPTS}"
            {code}

            h3. Solution

            Add the following to setenv.sh so that system settings are correctly propagated to the sandbox:
            {code:java}
            CATALINA_OPTS="-Dconversion.sandbox.java.options=-Dconfluence.document.conversion.slides.defaultfontname.regular=IPAGothic,-Dconfluence.document.conversion.slides.defaultfontname.asian=IPAGothic,-Dconfluence.document.conversion.slides.defaultfontname.symbol=IPAGothic,-Dconfluence.document.conversion.words.defaultfontname=IPAGothic ${CATALINA_OPTS}"
            {code}
            New: h3. Issue Summary

            Multibyte characters don't get rendered when conversion sandbox enabled even when appropriate font is installed with the following steps.
             [https://confluence.atlassian.com/confkb/non-ascii-characters-display-as-square-characters-in-confluence-317948797.html]
            h3. Environment
             * Confluence Data Center
             * document.conversion.sandbox.disable=false (same as default)
             * Multibyte font installed on the server
             ** "4 fonts package" of Japanese IPA fonts ([https://ipafont.ipa.go.jp/old/ipafont/download.html#en]) installed in
             *** /usr/share/fonts
             *** /opt/atlassian/confluence/jre/lib/fonts/fallback
             ** Following JVM argument is specified in setenv.sh
            {code:none}
            CATALINA_OPTS="-Dconfluence.document.conversion.fontpath=/usr/share/fonts/ -Dconfluence.document.conversion.slides.defaultfontname.regular=IPAGothic -Dconfluence.document.conversion.slides.defaultfontname.asian=IPAGothic -Dconfluence.document.conversion.slides.defaultfontname.symbol=IPAGothic ${CATALINA_OPTS}"
            CATALINA_OPTS="-Dconfluence.document.conversion.words.defaultfontname=IPAGothic ${CATALINA_OPTS}"
            {code}

            h3. Steps to Reproduce
             # Install Japanese fonts on the hosting server as described in above.
             # Start a Confluence Data Center instance
             # Attach [^テスト.pptx] in an editor

            h3. Expected Results

            "テストプレゼンテーション" is shown in thumbnail and preview.
            h3. Actual Results

            Square characters are shown for thumbnail and preview.
             * Thumbnail
             !Screen Shot 2018-11-29 at 18.11.04.png|thumbnail!

             * Preview
             !Screen Shot 2018-11-29 at 18.11.21.png|thumbnail!

            h3. Notes

            Characters are rendered correctly for some file type.
             As far as I confirmed in 6.12.2,
            ||file type||thumbnail||preview||
            |pptx|(x)|(x)|
            |docx|(/)|(x)|
            |xlsx|(/)|(/)|
            |txt|(/)|(x)|
            h3. Workaround

            Disable the conversion sandbox adding following option in setenv.sh. This is not recommended as it will affect the stability of the instance.
            {code:java}
            CATALINA_OPTS="-Ddocument.conversion.sandbox.disable=true ${CATALINA_OPTS}"
            {code}

            h3. Solution

            Add the following to setenv.sh so that system settings are correctly propagated to the sandbox:
            {code:java}
            CATALINA_OPTS="-Dconversion.sandbox.java.options=-Dconfluence.document.conversion.slides.defaultfontname.regular=IPAGothic,-Dconfluence.document.conversion.slides.defaultfontname.asian=IPAGothic,-Dconfluence.document.conversion.slides.defaultfontname.symbol=IPAGothic,-Dconfluence.document.conversion.words.defaultfontname=IPAGothic ${CATALINA_OPTS}"
            {code}
            Mark Bereznitsky made changes -
            Testing Notes New: Verified on an AWS cluster that adding the sandbox additional Java options catalina arguments fixes the issue.

              mbereznitsky Mark Bereznitsky
              nmukai Nobuyuki Mukai
              Affected customers:
              0 This affects my team
              Watchers:
              12 Start watching this issue

                Created:
                Updated:
                Resolved: