[BAM-17081] Bamboo is unable to retrieve shared artifact with files/folders containing special characters Created: 05/Jan/2016  Updated: 29/Jun/2017  Resolved: 06/Apr/2016

Status: Resolved
Project: Bamboo
Component/s: None
Affects Version/s: 5.9.7
Fix Version/s: 5.12.0.2

Type: Bug Priority: Low
Reporter: Gregoire Pailler Assignee: Przemyslaw Bruski
Resolution: Fixed Votes: 1
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Participants:
Last commented: 1 year, 46 weeks, 5 days ago
Last commented by user?: true
Comments: 4

 Description   

We have a plan with a build job and a tests job.

  • At the end of the build job, we publish a shared artifact of a folder containing test data (files and folders with special characters like BCZEAZrzetrygf216578986%µ%µ%£¨£P¨122&é''(-èè_ç_àçàè)新規フォルダ or 新規フォルダAZER.JPG).
  • In the test job, we have an artifact dependency to retrieve these test data but the job fails with following error
    INFO   | jvm 1    | 2016/01/04 15:43:35 | 2016-01-04 15:43:35,936 INFO [0-BAM::Build-Agent9::Agent:pool-3-thread-1] [BuildAgentControllerImpl] Remote Agent
    INFO   | jvm 1    | 2016/01/04 15:43:35 | 2016-01-04 15:43:35,936 INFO [0-BAM::Build-Agent9::Agent:pool-3-thread-1] [DefaultBuildAgent] Running build phase: com.atlassian.bamboo.v2.build.task.InitializeBuild
    INFO   | jvm 1    | 2016/01/04 15:43:36 | 2016-01-04 15:43:35,936 INFO [0-BAM::B uild-Agent9::Agent:pool-3-thread-1] [RemoteExecutionPhaseServiceImpl] PLAN - BRANCH - Unit tests #6 (PROJ-KEY57-UT-6) VCS sync started
    INFO   | jvm 1    | 2016/01/04 15:43:36 | 2016-01-04 15:43:35,968 INFO [0-BAM::Build-Agent9::Agent:pool-3-thread-1] [CheckoutDirectoriesSnapshotHelper] Build working directory is D:\DATA\Bamboo\Builds\PROJ-KEY57-UT
    INFO   | jvm 1    | 2016/01/04 15:43:36 | 2016-01-04 15:43:35,999 INFO [0-BAM::Build-Agent9::Agent:pool-3-thread-1] [DefaultBuildAgent] Running build phase: com.atlassian.bamboo.build.pipeline.tasks.PrepareBuildTask
    INFO   | jvm 1    | 2016/01/04 15:43:36 | 2016-01-04 15:43:35,999 INFO [0-BAM::Build-Agent9::Agent:pool-3-thread-1] [PrepareBuildTask] Executing build PLAN - BRANCH - Unit tests #6 (PROJ-KEY57-UT-6)
    INFO   | jvm 1    | 2016/01/04 15:43:36 | 2016-01-04 15:43:35,999 INFO [0-BAM::Build-Agent9::Agent:pool-3-thread-1] [PrepareBuildTask] Preparing artifact 'Binaries' for use at bin/
    INFO   | jvm 1    | 2016/01/04 15:43:36 | 2016-01-04 15:43:35,999 INFO [0-BAM::Build-Agent9::Agent:pool-3-thread-1] [AbstractArtifactManager] Trying to retrieve artifact with: class com.atlassian.bamboo.build.artifact BambooRemoteArtifactHandler
    INFO   | jvm 1    | 2016/01/04 15:45:02 | 2016-01-04 15:45:02,001 INFO [remoteEventRebroadcasterMessageListenerContainer-1] [RemoteEventRebroadcasterMessageListener] ExecutableQueueUpdate: addToQueue
    INFO   | jvm 1    | 2016/01/04 15:45:48 | 2016-01-04 15:45:48,176 ERROR [0-BAM::Build-Agent9::Agent:pool-3-thread-1] [BambooArtifactHttpTransport]
    INFO   | jvm 1    | 2016/01/04 15:45:48 | java.io.IOException: Invalid argument
    INFO   | jvm 1    | 2016/01/04 15:45:48 |       at java.io.WinNTFileSystem.canonicalize0(Native Method)
    INFO   | jvm 1    | 2016/01/04 15:45:48 |       at java.io.Win32FileSystem.canonicalize(Unknown Source)
    INFO   | jvm 1    | 2016/01/04 15:45:48 |       at java.io.File.getCanonicalPath(Unknown Source)
    INFO   | jvm 1    | 2016/01/04 15:45:48 |       at java.io.File.getCanonicalFile(Unknown Source)
    INFO   | jvm 1    | 2016/01/04 15:45:48 |       at com.atlassian.bamboo.util.BambooFileUtils.newFileUnderParent(BambooFileUtils.java:620)
    INFO   | jvm 1    | 2016/01/04 15:45:48 |       at com.atlassian.bamboo.v2.build.agent.messages.ArtifactStreams.deserialiseStreamToDir(ArtifactStreams.java:76)
    INFO   | jvm 1    | 2016/01/04 15:45:48 |       at com.atlassian.bamboo.build.artifact.BambooArtifactHttpTransport.retrieve(BambooArtifactHttpTransport.java:238)
    [BLABLABLABLABLA]
    INFO   | jvm 1    | 2016/01/04 15:45:48 |       at java.lang.Thread.run(UnknownSource)
    INFO   | jvm 1    | 2016/01/04 15:45:48 | 2016-01-04 15:45:48,176 WARN [0-BAM::Build-Agent9::Agent:pool-3-thread-1] [PrepareBuildTask] Failure in artifact preparation phase during processing of: Subscription for Shared artifact: [Binaries], pattern: [**/*] anchored at: [bin], destination: [bin]
    INFO   | jvm 1    | 2016/01/04 15:45:48 | 2016-01-04 15:45:48,176 WARN [0-BAM::Build-Agent9::Agent:pool-3-thread-1] [PrepareBuildTask] 1 error(s) found when performing pre-build actions.
    INFO   | jvm 1    | 2016/01/04 15:45:48 | 2016-01-04 15:45:48,176 INFO [0-BAM::Build-Agent9::Agent:pool-3-thread-1] [RemoteExecutionPhaseServiceImpl] PLAN - BRANCH - Unit tests #6 (PROJ-KEY57-UT-6) execution finished
    

As a workaround, we generate a zip and use this zip file as an artifact but it would be great if bamboo is able to handle these files seamlessly



 Comments   
Comment by ashley giles [ 25/Mar/2016 ]

I too get a similar log message:-
INFO [remoteEventRebroadcasterMessageListenerContainer-1] [RemoteEventRebroadcasterMessageListener] ExecutableQueueUpdate: addToQueue

and my bamboo remote agent hangs for an unlimited period of time. This happens only while executing test jobs for one of the plans. For the other plan jobs it works absolutely fine. The job for which it hangs , seem to be a normal job that runs RIT tests and this never occurred before even for the same job.
Is that something you could help me with.
Or could you please let me the root cause for the agent weird behaviour in this case.
This would be really helpful to troubleshoot the issue .

Thanks,
Ashley

Comment by ashley giles [ 28/Mar/2016 ]

Does Atlassian evenm care about this serious issue?
I haven't seen any comments on this issue for a long time.
This really now pisses me off, since its a serious issue thats affecting my team and i have no idea what to do.

Comment by Przemyslaw Bruski [ 28/Mar/2016 ]

Ashley, can you open a support ticket at support.atlassian.com and attach a thread dump from your agent/

Comment by ashley giles [ 29/Mar/2016 ]

I created one under following url:-
https://support.atlassian.com/servicedesk/customer/portal/10/BSP-24794

But this one doesn't provide me any ticket number.
Did i do something wrong or will that be automatically taken care of?

Please reply at the earliest.

Thanks,
Ashley

Generated at Mon Feb 19 05:49:38 UTC 2018 using JIRA 7.8.0-m0003#78000-sha1:e5ec29087cffe574ad41394afe143eb1de3ecdfb.