• 1
    • 6
    • Our product teams collect and evaluate feedback from a number of different sources. To learn more about how we use customer feedback in the planning process, check out our new feature policy.

      NOTE: This suggestion is for Confluence Cloud. Using Confluence Server? See the corresponding suggestion.

      Using the XML Backup/Restore feature for migrating between database types (or from HSQLDB) is not always feasible, especially for large instances. This process would benefit from working similarly to the migration process in FISHEYE as explained at https://confluence.atlassian.com/display/FISHEYE/Migrating+to+an+external+database.

      Since this would be a new feature to Confluence, it might also be helpful to add functionality to this process to migrate from one database type to another. This would improve the process for both customers and support, by decreasing the time it takes to perform the migration as well protect against data corruption that can happen in the current process.

      If it's feasible to do a leaf-to-root, enumerate-and-progressively-output approach, it could also lead to filesystem backups that don't have the current limitations on site size.

            [CONFCLOUD-12599] "Migrate to new database" feature

            Dan Keller added a comment -

            I was able to fix my issue by following this guide.

            Dan Keller added a comment - I was able to fix my issue by following this guide .

            dkeller1 it seems like you affected by https://jira.atlassian.com/browse/CONFDEV-25424

            Are you able to use postgres instead of mysql?

            Petro Semeniuk (Inactive) added a comment - dkeller1 it seems like you affected by https://jira.atlassian.com/browse/CONFDEV-25424 Are you able to use postgres instead of mysql?

            Dan Keller added a comment -

            After tinkering with a small (6.1MB) embedded database XML export, trying to import it to a MySQL db failing again and again, I would weep with joy if there were a more robust database migration tool.

            We were using the embedded database because we were testing the software and decided that we would move it to a production environment. Well, looks like that may not happen now, since we will lose all of our initial work. Does not instill much confidence.

            Troubleshooting this error is not how I wanted to spend my day:
            Caused by: java.sql.SQLException: Incorrect string value: '\xF0\x9F\x92\x99 C...' for column 'TITLE' at row 1

            Dan Keller added a comment - After tinkering with a small (6.1MB) embedded database XML export, trying to import it to a MySQL db failing again and again, I would weep with joy if there were a more robust database migration tool. We were using the embedded database because we were testing the software and decided that we would move it to a production environment. Well, looks like that may not happen now, since we will lose all of our initial work. Does not instill much confidence. Troubleshooting this error is not how I wanted to spend my day: Caused by: java.sql.SQLException: Incorrect string value: '\xF0\x9F\x92\x99 C...' for column 'TITLE' at row 1

            Tim Watts added a comment -

            I am sitting here fighting with an antique version of Confluence 3.2 wondering exactly how I am going to upgrade to the latest version.

            I have been trying to do this for 18 months - at each stage a problem is solved and a new one appears.

            For example, if your confluence-data filesystem is damaged and you lost some attachment files, you will find that the XML dump will quite happily reference them from the database but that the restore/reindex will fail.

            This is unforgivable - especially for a system that costs an awful lot. One of the purposes of a dump/restore cycle is to clean and validate what you are dumping - or at least to complain loudly at dump time if it really is broken.

            I would expect the dump format to be unified and independent of the database internals so that there would be no issues dumping 3.2 and restoring direct to 5.1. At the moment it cannot even competently dump 3.2 and restore to 3.2! To quote a phrase I heard the other day, I detect a certain amount of plebbery in some of Atlassian's core design and implementation.

            In my opinion this particular issue, whilst I agree with its sentiments, is the wrong approach. I would rather have a competent dump/restore feature which would make database migrations simple enough.

            Tim Watts added a comment - I am sitting here fighting with an antique version of Confluence 3.2 wondering exactly how I am going to upgrade to the latest version. I have been trying to do this for 18 months - at each stage a problem is solved and a new one appears. For example, if your confluence-data filesystem is damaged and you lost some attachment files, you will find that the XML dump will quite happily reference them from the database but that the restore/reindex will fail. This is unforgivable - especially for a system that costs an awful lot. One of the purposes of a dump/restore cycle is to clean and validate what you are dumping - or at least to complain loudly at dump time if it really is broken. I would expect the dump format to be unified and independent of the database internals so that there would be no issues dumping 3.2 and restoring direct to 5.1. At the moment it cannot even competently dump 3.2 and restore to 3.2! To quote a phrase I heard the other day, I detect a certain amount of plebbery in some of Atlassian's core design and implementation. In my opinion this particular issue, whilst I agree with its sentiments, is the wrong approach. I would rather have a competent dump/restore feature which would make database migrations simple enough.

            Jahsie added a comment -

            Making this process more efficient is critical. As Confluence becomes older the likelihood that your customers will transition to different server environments (and db's) will become much higher. This doesn't seem like a feature, it seems more like a core element.

            Jahsie added a comment - Making this process more efficient is critical. As Confluence becomes older the likelihood that your customers will transition to different server environments (and db's) will become much higher. This doesn't seem like a feature, it seems more like a core element.

            wcms added a comment -

            Would be great, we're having trouble migrating from internal to external database. Any update on this?

            wcms added a comment - Would be great, we're having trouble migrating from internal to external database. Any update on this?

            Davet added a comment -

            It is absurd that this should be rated as a feature!
            The whole backup strategy is a nightmare and unbecoming for an "enterprise" wiki. The dog's breakfast that is database backups goes from bad to worse when reading the documentation. e.g. "Atlassian does not support migrating to a new database" - I cannot believe that i am reading that!@#$%
            How has it ever been allowed to get to this abysmal state?
            Atlassian would be much better off just doing this rather than waiting for votes to count.

            Davet added a comment - It is absurd that this should be rated as a feature! The whole backup strategy is a nightmare and unbecoming for an "enterprise" wiki. The dog's breakfast that is database backups goes from bad to worse when reading the documentation. e.g. "Atlassian does not support migrating to a new database" - I cannot believe that i am reading that!@#$% How has it ever been allowed to get to this abysmal state? Atlassian would be much better off just doing this rather than waiting for votes to count.

            Are there any updates on this issue?

            Saul Perdomo added a comment - Are there any updates on this issue?

              Unassigned Unassigned
              jfleming James Fleming (Inactive)
              Votes:
              84 Vote for this issue
              Watchers:
              42 Start watching this issue

                Created:
                Updated: