Indexing fails for a git commit with a long author name

XMLWordPrintable

    • Severity 2 - Major

      Indexing fails with different errors depending on author attribute length.

      Minimal author name/email lengths that trigger the problem:

      export GIT_AUTHOR_NAME="$(for i in {1..1597}; do echo -n 'a'; done)" && export GIT_AUTHOR_EMAIL="e" && echo "a" >> a.txt && git add . && git commit -m "m"
      
      
      [java] 2016-10-26 09:15:44,045 WARN  - Problem processing revisions from repository test-git-repo2 (test-git-repo2) due to class com.cenqua.obfuscate.idb.C - cu=E606 2 A606 "__TRUNKLIKE__" "__ALL_EXTENSIONS__" "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa <e>" 0 17104 1
           [java] com.cenqua.obfuscate.idb.C: cu=E606 2 A606 "__TRUNKLIKE__" "__ALL_EXTENSIONS__" "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa <e>" 0 17104 1
           [java]     at com.cenqua.obfuscate.idb.y.b(InfinityDB_3.0.21:2628) [fisheye.jar:?]
           [java]     at com.atlassian.fisheye.bucket.InfinityDBConnector.addToData(InfinityDBConnector.java:115) [fisheye.jar:?]
           [java]     at com.atlassian.fisheye.bucket.InfinityDBConnector.addToData(InfinityDBConnector.java:96) [fisheye.jar:?]
           [java]     at com.atlassian.fisheye.bucket.InfinityDBConnector.addToData(InfinityDBConnector.java:90) [fisheye.jar:?]
           [java]     at com.atlassian.fisheye.bucket.InfinityDBConnector.addToData(InfinityDBConnector.java:78) [fisheye.jar:?]
           [java]     at com.atlassian.fisheye.bucket.Dir.addToCache(Dir.java:143) [fisheye.jar:?]
           [java]     at com.atlassian.fisheye.bucket.Dir.insertData(Dir.java:106) [fisheye.jar:?]
           [java]     at com.atlassian.fisheye.bucket.InsertIterator.insert(InsertIterator.java:24) [fisheye.jar:?]
           [java]     at com.atlassian.fisheye.bucket.BucketGraph.addRevision(BucketGraph.java:148) [fisheye.jar:?]
           [java]     at com.cenqua.fisheye.rep.blame.BaseBlameAndLinecountCalculator.calculateAndStoreRevisionData(BaseBlameAndLinecountCalculator.java:166) [fisheye.jar:?]
           [java]     at com.cenqua.fisheye.rep.blame.BaseBlameAndLinecountCalculator.indexRevisions(BaseBlameAndLinecountCalculator.java:147) [fisheye.jar:?]
           [java]     at com.cenqua.fisheye.rep.blame.BaseBlameAndLinecountCalculator.calcBlame(BaseBlameAndLinecountCalculator.java:83) [fisheye.jar:?]
           [java]     at com.cenqua.fisheye.rep.LifecycleRepositoryScanner.slurpRepository(LifecycleRepositoryScanner.java:129) [fisheye.jar:?]
           [java]     at com.atlassian.fisheye.git.GitScanner.slurpRepository(GitScanner.java:1597) [fisheye.jar:?]
           [java]     at com.cenqua.fisheye.rep.LifecycleRepositoryScanner.doSlurpTransaction(LifecycleRepositoryScanner.java:50) [fisheye.jar:?]
           [java]     at com.cenqua.fisheye.rep.BaseRepositoryScanner.ping(BaseRepositoryScanner.java:73) [fisheye.jar:?]
           [java]     at com.cenqua.fisheye.rep.BaseRepositoryEngine.doSlurp(BaseRepositoryEngine.java:85) [fisheye.jar:?]
           [java]     at com.cenqua.fisheye.rep.RepositoryEngine.slurp(RepositoryEngine.java:419) [fisheye.jar:?]
           [java]     at com.cenqua.fisheye.rep.ping.IndexingPingRequest.doRequest(IndexingPingRequest.java:28) [fisheye.jar:?]
           [java]     at com.cenqua.fisheye.rep.ping.OneOffPingRequest.doRequest(OneOffPingRequest.java:18) [fisheye.jar:?]
           [java]     at com.cenqua.fisheye.rep.ping.PingRequest$1.run(PingRequest.java:55) [fisheye.jar:?]
           [java]     at com.cenqua.fisheye.util.NamedExecution.run(NamedExecution.java:27) [fisheye.jar:?]
           [java]     at com.cenqua.fisheye.rep.ping.PingRequest.process(PingRequest.java:52) [fisheye.jar:?]
           [java]     at com.cenqua.fisheye.rep.RepositoryHandle.processPingRequests(RepositoryHandle.java:211) [fisheye.jar:?]
           [java]     at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_77]
           [java]     at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_77]
           [java]     at java.lang.Thread.run(Thread.java:745) [?:1.8.0_77]
      
      

      For a longer author name another error occurs:

      export GIT_AUTHOR_NAME="$(for i in {1..2000}; do echo -n 'a'; done)" && export GIT_AUTHOR_EMAIL="e" && echo "a" >> a.txt && git add . && git commit -m "m"
      
      
      [java] 2016-10-26 09:16:09,602 WARN  - Problem processing revisions from repository test-git-repo2 (test-git-repo2) due to class com.cenqua.fisheye.rep.RepositoryClientException - com.atlassian.fisheye.dvcs.handler.DvcsProcessException: Error while communicating with VCS:
           [java] com.cenqua.fisheye.rep.RepositoryClientException: com.atlassian.fisheye.dvcs.handler.DvcsProcessException: Error while communicating with VCS:
           [java]     at com.atlassian.fisheye.dvcs.DvcsScanner.processRevisions(DvcsScanner.java:345) [fisheye.jar:?]
           [java]     at com.atlassian.fisheye.git.GitScanner.processRevisions(GitScanner.java:385) [fisheye.jar:?]
           [java]     at com.cenqua.fisheye.rep.LifecycleRepositoryScanner.slurpRepository(LifecycleRepositoryScanner.java:83) [fisheye.jar:?]
           [java]     at com.atlassian.fisheye.git.GitScanner.slurpRepository(GitScanner.java:1597) [fisheye.jar:?]
           [java]     at com.cenqua.fisheye.rep.LifecycleRepositoryScanner.doSlurpTransaction(LifecycleRepositoryScanner.java:50) [fisheye.jar:?]
           [java]     at com.cenqua.fisheye.rep.BaseRepositoryScanner.ping(BaseRepositoryScanner.java:73) [fisheye.jar:?]
           [java]     at com.cenqua.fisheye.rep.BaseRepositoryEngine.doSlurp(BaseRepositoryEngine.java:85) [fisheye.jar:?]
           [java]     at com.cenqua.fisheye.rep.RepositoryEngine.slurp(RepositoryEngine.java:419) [fisheye.jar:?]
           [java]     at com.cenqua.fisheye.rep.ping.IndexingPingRequest.doRequest(IndexingPingRequest.java:28) [fisheye.jar:?]
           [java]     at com.cenqua.fisheye.rep.ping.OneOffPingRequest.doRequest(OneOffPingRequest.java:18) [fisheye.jar:?]
           [java]     at com.cenqua.fisheye.rep.ping.PingRequest$1.run(PingRequest.java:55) [fisheye.jar:?]
           [java]     at com.cenqua.fisheye.util.NamedExecution.run(NamedExecution.java:27) [fisheye.jar:?]
           [java]     at com.cenqua.fisheye.rep.ping.PingRequest.process(PingRequest.java:52) [fisheye.jar:?]
           [java]     at com.cenqua.fisheye.rep.RepositoryHandle.processPingRequests(RepositoryHandle.java:211) [fisheye.jar:?]
           [java]     at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_77]
           [java]     at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_77]
           [java]     at java.lang.Thread.run(Thread.java:745) [?:1.8.0_77]
           [java] Caused by: com.atlassian.fisheye.dvcs.handler.DvcsProcessException: Error while communicating with VCS:
           [java]     at com.atlassian.fisheye.dvcs.client.DvcsContext.executeWithInput(DvcsContext.java:226) [fisheye.jar:?]
           [java]     at com.atlassian.fisheye.git.GitScanner.processChanges(GitScanner.java:1431) [fisheye.jar:?]
           [java]     at com.atlassian.fisheye.git.GitScanner.slurpCommits(GitScanner.java:1402) [fisheye.jar:?]
           [java]     at com.atlassian.fisheye.dvcs.DvcsScanner.processCommitStream(DvcsScanner.java:534) [fisheye.jar:?]
           [java]     at com.atlassian.fisheye.dvcs.DvcsScanner.processBranch(DvcsScanner.java:492) [fisheye.jar:?]
           [java]     at com.atlassian.fisheye.dvcs.DvcsScanner.processRevisions(DvcsScanner.java:270) [fisheye.jar:?]
           [java]     ... 16 more
           [java] Caused by: com.atlassian.utils.process.ProcessException: While executing: "git show -m --no-abbrev --raw --stdin --no-renames --pretty=format:C:%H%nP:%P%nA:%aN%nE:%aE%nR:%cN%nF:%cE%nD:%at%nS:%s%nB:%b%n@@fe_body_end@@" in [/Users/mikolaj/projects/fecru2/output/dist_inst/var/cache/test-git-repo2/clone]
           [java]     at com.atlassian.fisheye.dvcs.client.DvcsContext.executeCommand(DvcsContext.java:263) [fisheye.jar:?]
           [java]     at com.atlassian.fisheye.dvcs.client.DvcsContext.executeCommand(DvcsContext.java:235) [fisheye.jar:?]
           [java]     at com.atlassian.fisheye.dvcs.client.DvcsContext.executeWithInput(DvcsContext.java:224) [fisheye.jar:?]
           [java]     ... 21 more
           [java] Caused by: com.atlassian.utils.process.ProcessException: java.lang.RuntimeException: Error processing path GitChangePath{action=ADD, srcPath='null', path='a.txt', srcHash='0000000000000000000000000000000000000000', destHash='78981922613b2afb6025042ff6bd878ac1994e85', destMode=33188}
           [java]     at com.atlassian.utils.process.PluggableProcessHandler.setException(PluggableProcessHandler.java:158) [atlassian-processutils-1.5.14.jar:?]
           [java]     at com.atlassian.utils.process.PluggableProcessHandler.complete(PluggableProcessHandler.java:50) [atlassian-processutils-1.5.14.jar:?]
           [java]     at com.atlassian.utils.process.ExternalProcessImpl.wrapUpProcess(ExternalProcessImpl.java:509) [atlassian-processutils-1.5.14.jar:?]
           [java]     at com.atlassian.utils.process.ExternalProcessImpl.finish(ExternalProcessImpl.java:423) [atlassian-processutils-1.5.14.jar:?]
           [java]     at com.atlassian.utils.process.ExternalProcessImpl.execute(ExternalProcessImpl.java:378) [atlassian-processutils-1.5.14.jar:?]
           [java]     at com.atlassian.fisheye.dvcs.client.DvcsContext.executeCommand(DvcsContext.java:250) [fisheye.jar:?]
           [java]     ... 23 more
           [java] Caused by: java.lang.RuntimeException: Error processing path GitChangePath{action=ADD, srcPath='null', path='a.txt', srcHash='0000000000000000000000000000000000000000', destHash='78981922613b2afb6025042ff6bd878ac1994e85', destMode=33188}
           [java]     at com.atlassian.fisheye.git.GitScanner.processChangePath(GitScanner.java:1020) [fisheye.jar:?]
           [java]     at com.atlassian.fisheye.git.GitScanner.processFileRevisions(GitScanner.java:949) [fisheye.jar:?]
           [java]     at com.atlassian.fisheye.git.GitScanner.processGitCommit(GitScanner.java:875) [fisheye.jar:?]
           [java]     at com.atlassian.fisheye.git.GitScanner$13.processCommit(GitScanner.java:1538) [fisheye.jar:?]
           [java]     at com.atlassian.fisheye.git.client.GitChangeParser.handleCommit(GitChangeParser.java:235) [fisheye.jar:?]
           [java]     at com.atlassian.fisheye.git.client.GitChangeParser.complete(GitChangeParser.java:228) [fisheye.jar:?]
           [java]     at com.atlassian.utils.process.PluggableProcessHandler.complete(PluggableProcessHandler.java:48) [atlassian-processutils-1.5.14.jar:?]
           [java]     ... 27 more
           [java] Caused by: com.cenqua.obfuscate.idb.C: cu=E100 1 A4
           [java]     at com.cenqua.obfuscate.idb.y.b(InfinityDB_3.0.21:1584) [fisheye.jar:?]
           [java]     at com.cenqua.fisheye.rep.impl.CommonRevInfoDAO.insertAuthor(CommonRevInfoDAO.java:1142) [fisheye.jar:?]
           [java]     at com.cenqua.fisheye.rep.impl.CommonRevInfoDAO.insertNew(CommonRevInfoDAO.java:559) [fisheye.jar:?]
           [java]     at com.atlassian.fisheye.dvcs.db.DvcsRevInfoDAO.insertNew(DvcsRevInfoDAO.java:70) [fisheye.jar:?]
           [java]     at com.atlassian.fisheye.git.db.GitRevInfoDAO.insertNew(GitRevInfoDAO.java:40) [fisheye.jar:?]
           [java]     at com.atlassian.fisheye.git.GitScanner.insertNewRevision(GitScanner.java:1296) [fisheye.jar:?]
           [java]     at com.atlassian.fisheye.git.GitScanner.processAddition(GitScanner.java:1206) [fisheye.jar:?]
           [java]     at com.atlassian.fisheye.git.GitScanner.processChangePath(GitScanner.java:995) [fisheye.jar:?]
           [java]     ... 33 more
      
      

       

       Note that other commit properties (like message, linecount, hash etc) might also affect this as concatenated commit data is processed, so the error might appear for shorter author name/email too.

            Assignee:
            Unassigned
            Reporter:
            Mikolaj Zyromski
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated:
              Resolved: