Atlassian Update: Dec 22, 2016 - 01:30 UTC
      The fix for the problem that caused the incident was released to all sites.

      We found sites where the add-on has been installed in the last few days that are affected by different problems.
      We are still working towards fixing these sites and will keep reporting updates on this bug report.

      Summary

      Connect add-on such as Gliffy, Balsamiq mockups or Bobswift macros are failing to load with an Unauthorised message. This is not an exhaustive list, some add-on symptoms may include:

      Gliffy diagrams don't display on any page.
      Balsamiq mockups display in grey and not load.
      Bobswift add-ons show a loading message: Add-on <add-on name> is not responding. Wait or cancel?
      401 error message is shown when trying to edit some of the macros or visible in the browser console.

      Environment

      • Confluence Cloud v1000.690.0

      Steps to Reproduce

      1. Navigate to a page with a Gliffy diagram. (can be found by searching for: " macroName: gliffy* " )

      Expected Results

      The Gliffy diagram is displayed.

      Actual Results

      The diagram is not displayed. The page renders correctly but where the diagram is located, it's blank, no errors are shown on screen.

      Browser Console and Network tabs of the Development Tools show 401 (Unauthorized) for

      https://confluence-connect.gliffy.net/macro/render?space=XX&container=98566170&....
      

      similar behaviour for other Atlassian Connect add-ons.

      Updates:

      The fix was applied to all sites but there are some sites still experiencing problems.

      • If an add-on was installed during the last 4 days it is possible that the installation will still be broken. We are taking actions to solve this scenario as well.
      • There is also a handful of sites with add-on configurations that will need to be manually fixed and Atlassian is contacting the plugin vendors to solve that situation.

          Form Name

            [CONFCLOUD-53245] Confluence add-ons are not working

            Dario B added a comment -

            Hi loginov2000508768,

            Please file a support request in support.atlassian.com to have your issue investigated.


            Best Regards,
            Dario
            Atlassian Cloud Support

            Dario B added a comment - Hi loginov2000508768 , Please file a support request in support.atlassian.com to have your issue investigated. Best Regards, Dario Atlassian Cloud Support

            We still have problems with gliffy. Please check our instance on mandetect.atlassian.net

            Neverpoint added a comment - We still have problems with gliffy. Please check our instance on mandetect.atlassian.net

            Ziming Wang added a comment - - edited

            Hi all, we have fixed the bug which caused this incident and have scheduled work to address the underlying root cause. We have also restored functionality to all but a handful of add-on installations, and are continuing to work with the add-on vendors on the remaining few issues. For any new issues, please do not leave a comment here, but rather raise a ticket with our support staff at https://support.atlassian.com.  Moreover, can you please tell us which add-ons are affected on your instance?

            This will ensure we can work with you to resolve any issues as quickly as possible.

            Ziming Wang added a comment - - edited Hi all, we have fixed the bug which caused this incident and have scheduled work to address the underlying root cause. We have also restored functionality to all but a handful of add-on installations, and are continuing to work with the add-on vendors on the remaining few issues. For any new issues, please do not leave a comment here, but rather raise a ticket with our support staff at https://support.atlassian.com .  Moreover, can you please tell us which add-ons are affected on your instance? This will ensure we can work with you to resolve any issues as quickly as possible.

            We are still experiencing the issue with Advanced Tables in our instance ( https://underarmour.atlassian.net/ )
            Do you have an ETA for a fix?

            Thanks,
            Alex.

            Alexei Solovyov added a comment - We are still experiencing the issue with Advanced Tables in our instance ( https://underarmour.atlassian.net/ ) Do you have an ETA for a fix? Thanks, Alex.

            Should Presenter be affected by this? In my case it displays:

            Your license has expired
            Go to the "Manage add-ons" page to review your license status and renew your license.

             

            Reinstallation appears to either silently fail or display an unexpected error message. The developer doesn't seem to think it's their code.

             

            Thanks,

            Michael

             

            Michael Harradon added a comment - Should Presenter be affected by this? In my case it displays: Your license has expired Go to the "Manage add-ons" page to review your license status and renew your license.   Reinstallation appears to either silently fail or display an unexpected error message. The developer doesn't seem to think it's their code.   Thanks, Michael  

            Dear Atlassian,

            The problem keeps occurring in my Confluence-pages. Add-ons render correctly but the error message keeps occurring

            Kind regards, Niels William Porsborg

            Niels William Porsborg added a comment - Dear Atlassian, The problem keeps occurring in my Confluence-pages. Add-ons render correctly but the error message keeps occurring Kind regards, Niels William Porsborg

            Mauro,

            We are still having gliffy digrams not being displayed.  Are you working on our Cloud site or is this expected to be working at this time?

            rocitsolutions.atlassian.net

            --Bradley

            Bradley Moyer added a comment - Mauro, We are still having gliffy digrams not being displayed.  Are you working on our Cloud site or is this expected to be working at this time? rocitsolutions.atlassian.net --Bradley

            Atlassian worked together with the add-on developers to fix the remaining sites that installed add-ons in the last few days and the majority of these have already been fixed.

            We'll keep this bug open for a few more days while we wrap up the remaining add-ons still being worked on.

            Thanks for the patience and understanding.

            Kind regards,
            Mauro

            Mauro Badii (Inactive) added a comment - Atlassian worked together with the add-on developers to fix the remaining sites that installed add-ons in the last few days and the majority of these have already been fixed. We'll keep this bug open for a few more days while we wrap up the remaining add-ons still being worked on. Thanks for the patience and understanding. Kind regards, Mauro

            I have updated my incident JST-244625 with details of this and requested to have the fix implemented asap but not received a response for over 2 hours! This is very urgent now!`

            Andy Stewart added a comment - I have updated my incident  JST-244625  with details of this and requested to have the fix implemented asap but not received a response for over 2 hours! This is very urgent now!`

            michael.owen1822890299 added a comment -

            Has this fix been implemented yet? My Gliffy add on still is not working and i cant get it to reinstall. Please advise. 

            michael.owen1822890299 added a comment - Has this fix been implemented yet? My Gliffy add on still is not working and i cant get it to reinstall. Please advise. 

            scott1758096275 - thanks for the note, we are aware of the issue and are about to reach out privately to ensure our customers can get up and running ASAP.

            tim1512534419 - "mixed add-on key" was not accurate, I've updated the description to be more accurate: "incorrect add-on configuration"

            ellwyn557720882 - we'll be in touch with the Create Your Own Macro add-on developer and get you back up and running as soon as possible.

            Seb Ruiz (Inactive) added a comment - scott1758096275 - thanks for the note, we are aware of the issue and are about to reach out privately to ensure our customers can get up and running ASAP. tim1512534419 - "mixed add-on key" was not accurate, I've updated the description to be more accurate: "incorrect add-on configuration" ellwyn557720882 - we'll be in touch with the Create Your Own Macro add-on developer and get you back up and running as soon as possible.

            Ellwyn Tan added a comment -

            I have imported some charts frroom google drive and visualisations from Tableau in my page using the Create Your Own Macro application the last few days. Yesterday, these charts and visualisations cannot be displayed on the page. The error message is as follows:
            "Add-on authentication
            A successful JWT authentication is required for this page"

            Is it the same problem? 

            Ellwyn Tan added a comment - I have imported some charts frroom google drive and visualisations from Tableau in my page using the Create Your Own Macro application the last few days. Yesterday, these charts and visualisations cannot be displayed on the page. The error message is as follows: "Add-on authentication A successful JWT authentication is required for this page" Is it the same problem? 

            Tim added a comment -

            If I may ask what's a "mixed add-on key"?

            Tim added a comment - If I may ask what's a "mixed add-on key"?

            thanks scott1758096275 for adding information to the case
            We are aware and working on that scenario as well and we are contacting plugin vendors to solve the situations.
            Cheers

            Mauro Badii (Inactive) added a comment - thanks scott1758096275 for adding information to the case We are aware and working on that scenario as well and we are contacting plugin vendors to solve the situations. Cheers

            Scott added a comment -

            Please note that two of my customers, who had reported the 401 issue yesterday, and were able to workaround the problem by uninstalling & reinstalling the add-on, have now both reported the following error today:

            Unauthorized: Unable to decode JWT token: Error: Signature verification failed for input: eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiJmZjgwODA4MTU1ZTZmZTYyMDE1NWU2ZmU4MTM2MDAwMiIsInFzaCI6IjA4NTExMWQyNGVkYTlmYTdhMDk1NWI2ZTg2NTY5OTc5NDZhMmM2NTBkZDc0MmVjYjk2Y2ExZDBjN2JiOGIzZmMiLCJpc3MiOiJDb25mbHVlbmNlOjUwNDkxNzA3MzIiLCJjb250ZXh0Ijp7InVzZXIiOnsidXNlcktleSI6ImZmODA4MDgxNTVlNmZlNjIwMTU1ZTZmZTgxMzYwMDAyIiwidXNlcm5hbWUiOiJqZXNzIiwiZGlzcGxheU5hbWUiOiJKZXNzIE11cnBoeSJ9fSwiZXhwIjoxNDgyMjg3OTc2LCJpYXQiOjE0ODIyODc3OTZ9 with method sha256

            My assumption is that this is the same error implied by the 'Updates' comment above:

            "If an add-on was installed during the last 4 days it is possible that the installation will still be broken. We are taking actions to solve this scenario as well."

            ...but I felt that I should report this in case this is a new, separate error that also needs to be investigated as part of the ongoing incident.

            Scott added a comment - Please note that two of my customers, who had reported the 401 issue yesterday, and were able to workaround the problem by uninstalling & reinstalling the add-on, have now both reported the following error today: Unauthorized: Unable to decode JWT token: Error: Signature verification failed for input: eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiJmZjgwODA4MTU1ZTZmZTYyMDE1NWU2ZmU4MTM2MDAwMiIsInFzaCI6IjA4NTExMWQyNGVkYTlmYTdhMDk1NWI2ZTg2NTY5OTc5NDZhMmM2NTBkZDc0MmVjYjk2Y2ExZDBjN2JiOGIzZmMiLCJpc3MiOiJDb25mbHVlbmNlOjUwNDkxNzA3MzIiLCJjb250ZXh0Ijp7InVzZXIiOnsidXNlcktleSI6ImZmODA4MDgxNTVlNmZlNjIwMTU1ZTZmZTgxMzYwMDAyIiwidXNlcm5hbWUiOiJqZXNzIiwiZGlzcGxheU5hbWUiOiJKZXNzIE11cnBoeSJ9fSwiZXhwIjoxNDgyMjg3OTc2LCJpYXQiOjE0ODIyODc3OTZ9 with method sha256 My assumption is that this is the same error implied by the 'Updates' comment above: "If an add-on was installed during the last 4 days it is possible that the installation will still be broken. We are taking actions to solve this scenario as well." ...but I felt that I should report this in case this is a new, separate error that also needs to be investigated as part of the ongoing incident.

            For all draw.io users thinking of sending us a link to this ticket asking whether draw.io add-on is affected, there's no need, it's not. The affected add-ons seem to be those that authenticate a remote server to your Confluence instance and it's that authentication that is failing. draw.io doesn't require passing your Confluence authentication anywhere externally, whereas, most other add-ons do this.

            David Benson [draw.io] added a comment - For all draw.io users thinking of sending us a link to this ticket asking whether draw.io add-on is affected, there's no need, it's not. The affected add-ons seem to be those that authenticate a remote server to your Confluence instance and it's that authentication that is failing. draw.io doesn't require passing your Confluence authentication anywhere externally, whereas, most other add-ons do this.

            Bob Swift added a comment -

            Bob Swift added a comment - See http://status.atlassian.com/incidents/3hzqdpjrggrq  for the latest news.

            Jander Tavares added a comment - - edited

            Hello, Atlassian, there is anybody there?

            Jander Tavares added a comment - - edited Hello, Atlassian, there is anybody there?

            +1 on other comments re production system - we heavily depend on add-ons for most of our wiki pages which are now rendered useless. Great inconvenience for our organisation.

            Accidents do happen, but this has been going on for more than a full workday with no updates from Atlassian.

            When can we expect a fix?

            How come you didn't do a rollback 11 hours ago?

             

            Geir Gullestad Pettersen added a comment - +1 on other comments re production system - we heavily depend on add-ons for most of our wiki pages which are now rendered useless. Great inconvenience for our organisation. Accidents do happen, but this has been going on for more than a full workday with no updates from Atlassian. When can we expect a fix? How come you didn't do a rollback 11 hours ago?  

            "There were errors rendering macro: Unknown error. Status is 401" error when showing Multiexcerpts

            Thomas Lindner added a comment - "There were errors rendering macro: Unknown error. Status is 401" error when showing Multiexcerpts

            Steffen H added a comment -

            We have issues with "Advanced Tables Plugin" not loading - just seeing a spinning wheel. Tested in Firefox and Chrome (latest versions)

            Steffen H added a comment - We have issues with "Advanced Tables Plugin" not loading - just seeing a spinning wheel. Tested in Firefox and Chrome (latest versions)

            We have the same error with "Numbered Headings" and "Lucidchart Diagrams". They both show 401 error messages.

            David Hagman added a comment - We have the same error with "Numbered Headings" and "Lucidchart Diagrams". They both show 401 error messages.

            We have the same problem. 

            Is there any update from Atlassian team?

            Jander Tavares added a comment - We have the same problem.  Is there any update from Atlassian team?

            DataTeam added a comment -

            We've same problems with Gliffy diagrams

            DataTeam added a comment - We've same problems with Gliffy diagrams

            We are also experiencing this issue with gliffy diagrams

            Richard Gaunt added a comment - We are also experiencing this issue with gliffy diagrams

            The gliffy diagrams don't show at all, we just can see error 401.

            Please fix

            Ranjdar Fallyih added a comment - The gliffy diagrams don't show at all, we just can see error 401. Please fix

            same problem here, please fix.

            On 13-DEC we had similar problem. At that time my colleague could solve it by running an update.

            After that update, the gliffy diagrams would show, but not after displaying a spinner for a couple of seconds.

            Today, the gliffy diagrams don't show at all. This applies to unmodified pages as well as new diagrams.

            Jaap Francke added a comment - same problem here, please fix. On 13-DEC we had similar problem. At that time my colleague could solve it by running an update. After that update, the gliffy diagrams would show, but not after displaying a spinner for a couple of seconds. Today, the gliffy diagrams don't show at all. This applies to unmodified pages as well as new diagrams.

            This is causing some major headaches for our organisation. Bobswift advance tables are just spinning away doing nowt. Its affecting our developers from seeing important information for our systems. Only work around is to edit the page and see the info required - which as one can imagine is dangerous in the wrong hands.....give us a fix quick.

            Stephen Morning added a comment - This is causing some major headaches for our organisation. Bobswift advance tables are just spinning away doing nowt. Its affecting our developers from seeing important information for our systems. Only work around is to edit the page and see the info required - which as one can imagine is dangerous in the wrong hands.....give us a fix quick.

            plus one on: This is a production system which our team rely on to share information and collaborate on a daily basis. One of key the reasons we use the Atlassian suite is the marketplace add ons.

            duncan hallas added a comment - plus one on: This is a production system which our team rely on to share information and collaborate on a daily basis. One of key the reasons we use the Atlassian suite is the marketplace add ons.

            Scott added a comment -

            The current incident on status.atlassian.com was created 5 hours ago and has had no updates since.

            I am receiving feedback emails from customers that are uninstalling my add-ons with comments like "bugs in the add-on" or "not working", or leaving 1-star reviews again the Marketplace listing.

            A number of my customers affected by this issue (I am tracking the different client keys that report 401 errors in my server logs, across multiple add-ons), and many of them are yet to contact me for support, so I can only assume that they are under the impression that the issue is the fault of my add-on.

            I really feel that at this point there should be a notice shown to customers (perhaps on the Manage Add-ons page?) advising them that this is a general Confluence issue, and not an issue with specific vendors or add-ons.

            At this point, it feels as though I'm losing existing and potential customers through no fault of my own.

            Scott added a comment - The current incident on status.atlassian.com was created 5 hours ago and has had no updates since. I am receiving feedback emails from customers that are uninstalling my add-ons with comments like "bugs in the add-on" or "not working", or leaving 1-star reviews again the Marketplace listing. A number of my customers affected by this issue (I am tracking the different client keys that report 401 errors in my server logs, across multiple add-ons), and many of them are yet to contact me for support, so I can only assume that they are under the impression that the issue is the fault of my add-on. I really feel that at this point there should be a notice shown to customers (perhaps on the Manage Add-ons page?) advising them that this is a general Confluence issue, and not an issue with specific vendors or add-ons. At this point, it feels as though I'm losing existing and potential customers through no fault of my own.

            The last couple of months have been quite rough for Atlassian and as JIRA and Confluence users I can say we've had more issues than reasons to say "Wow, we really like this software and it's totally worth the money we are paying"...

            Stoyan Ivanov added a comment - The last couple of months have been quite rough for Atlassian and as JIRA and Confluence users I can say we've had more issues than reasons to say "Wow, we really like this software and it's totally worth the money we are paying"...

            We're experiencing this issue. This is the latest in a string of issues around Confluence, add-on's and attachments.

            I'm afraid you're on the verge of losing me as an advocate of Confluence. This is a production system which our IT department rely on to share information and collaborate on a daily basis. 

            Jamie Yates added a comment - We're experiencing this issue. This is the latest in a string of issues around Confluence, add-on's and attachments. I'm afraid you're on the verge of losing me as an advocate of Confluence. This is a production system which our IT department rely on to share information and collaborate on a daily basis. 

            Hi Atlassian, Right now I experience even more severe problems. It has become impossible to edit Gliffy diagrams, since they open as their source code. Is it possible that it has anything to do with the rest of this issue?

            Best regards, Niels

            Niels William Porsborg added a comment - Hi Atlassian, Right now I experience even more severe problems. It has become impossible to edit Gliffy diagrams, since they open as their source code. Is it possible that it has anything to do with the rest of this issue? Best regards, Niels

              zwang@atlassian.com Ziming Wang
              mfernandezbadii Mauro Badii (Inactive)
              Affected customers:
              33 This affects my team
              Watchers:
              63 Start watching this issue

                Created:
                Updated:
                Resolved: