Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-13494

lsst_build fetch errors - fatal: index file smaller than expected

    Details

    • Type: Bug
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: Continuous Integration
    • Labels:
      None
    • Templates:
    • Story Points:
      0.25
    • Epic Link:
    • Team:
      SQuaRE

      Description

      There has been multiple reports of stack-os-matrix builds failing when preparing the source tree on centos-6.py3. It appears that all of these errors have happened during git fetch and are happening across multiple nodes.

      Eg.

      https://ci.lsst.codes/blue/organizations/jenkins/stack-os-matrix/detail/stack-os-matrix/27464/pipeline/35

                  apr_util: Traceback (most recent call last):
       
        File "/home/jenkins-slave/workspace/stack-os-matrix/centos-6.py3/lsstsw/lsst_build/bin/lsst-build", line 51, in <module>
       
          args.func(args)
       
        File "/home/jenkins-slave/workspace/stack-os-matrix/centos-6.py3/lsstsw/lsst_build/python/lsst/ci/prepare.py", line 785, in run
       
          manifest = p.construct(args.products)
       
        File "/home/jenkins-slave/workspace/stack-os-matrix/centos-6.py3/lsstsw/lsst_build/python/lsst/ci/prepare.py", line 747, in construct
       
          self._add_product_tree(products, name)
       
        File "/home/jenkins-slave/workspace/stack-os-matrix/centos-6.py3/lsstsw/lsst_build/python/lsst/ci/prepare.py", line 735, in _add_product_tree
       
          dependencies.append(self._add_product_tree(products, dprod.name))
       
        File "/home/jenkins-slave/workspace/stack-os-matrix/centos-6.py3/lsstsw/lsst_build/python/lsst/ci/prepare.py", line 735, in _add_product_tree
       
          dependencies.append(self._add_product_tree(products, dprod.name))
       
        File "/home/jenkins-slave/workspace/stack-os-matrix/centos-6.py3/lsstsw/lsst_build/python/lsst/ci/prepare.py", line 735, in _add_product_tree
       
          dependencies.append(self._add_product_tree(products, dprod.name))
       
        [Previous line repeated 3 more times]
       
        File "/home/jenkins-slave/workspace/stack-os-matrix/centos-6.py3/lsstsw/lsst_build/python/lsst/ci/prepare.py", line 718, in _add_product_tree
       
          ref, sha1 = self.product_fetcher.fetch(product_name)
       
        File "/home/jenkins-slave/workspace/stack-os-matrix/centos-6.py3/lsstsw/lsst_build/python/lsst/ci/prepare.py", line 327, in fetch
       
          git.fetch("-fup", "origin", "+refs/heads/*:refs/heads/*", "refs/tags/*:refs/tags/*")
       
        File "/home/jenkins-slave/workspace/stack-os-matrix/centos-6.py3/lsstsw/lsst_build/python/lsst/ci/git.py", line 61, in fetch
       
          return self('fetch', *args, **kwargs)
       
        File "/home/jenkins-slave/workspace/stack-os-matrix/centos-6.py3/lsstsw/lsst_build/python/lsst/ci/git.py", line 44, in __call__
       
          raise GitError(retcode, cmd, stdout, stderr)
       
      lsst.ci.git.GitError: Command '['git', 'fetch', '-fup', 'origin', '+refs/heads/*:refs/heads/*', 'refs/tags/*:refs/tags/*']' returned non-zero exit status 128.
       
      stdout:
       
       
      stderr:
       
      fatal: index file smaller than expected
       
       
      Failed during rebuild of DM stack.
       
      script returned exit code 1
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                jhoblitt Joshua Hoblitt
                Reporter:
                jhoblitt Joshua Hoblitt
                Watchers:
                Joshua Hoblitt, Krzysztof Findeisen, Robert Lupton, Tim Jenness
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel