Trying to backup to Zipped XML results in the following error:

An exception occurred backing up: com.atlassian.core.AtlassianCoreException: Error in action: <a href='mailto:com.atlassian.jira.action.admin.DataExport@1afd643'>com.atlassian.jira.action.admin.DataExport@1afd643</a>, result: error<br> Error exporting: java.io.IOException: The character '�' is an invalid XML character

Character is 0x1C

Location of exported file is irrelevant, as is the zip option and extension.

Last text in the exported file:
<ChangeItem field="status" group="10581" id="10988"
newstring="Resolved" newvalue="5" oldstring="A