Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-33356

obs_base-g20ff5da1ef+ff9f4b6609 is not being published

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: jenkins
    • Labels:
      None
    • Team:
      SQuaRE
    • Urgent?:
      No

      Description

      This package is being successfully built, rebuilt from source as part of the pipelines/release/tarball.groovy job, and even smoke-tested from the temporary filesystem "distribution server". I see the appropriate tarball in the distrib directory in /project/jenkins/prod at NCSA. The aws s3 cp command from that distrib directory appears to succeed, but the tarball does not end up being visible in S3.

      I'm wondering if this is due to the S3 bucket filling up.

        Attachments

          Activity

          Hide
          ktl Kian-Tat Lim added a comment -

          https://ci.lsst.codes/blue/organizations/jenkins/release%2Ftarball/detail/tarball/7762/pipeline is the publish Jenkins job with the supposedly-successful copy.

          Show
          ktl Kian-Tat Lim added a comment - https://ci.lsst.codes/blue/organizations/jenkins/release%2Ftarball/detail/tarball/7762/pipeline is the publish Jenkins job with the supposedly-successful copy.
          Hide
          ktl Kian-Tat Lim added a comment -

          /project/jenkins/prod/agent-ldfc-ws-2/ws/release/tarball/b09919c18f/distrib at NCSA is the directory that is being copied from. It contains obs_base-g20ff5da1ef+ff9f4b6609@Linux64.tar.gz, which is the tarball that is to be copied. That should end up at https://eups.lsst.codes/stack/redhat/el7/conda-system/miniconda3-py38_4.9.2-0.7.0/ but it is not there.

          Show
          ktl Kian-Tat Lim added a comment - /project/jenkins/prod/agent-ldfc-ws-2/ws/release/tarball/b09919c18f/distrib at NCSA is the directory that is being copied from. It contains obs_base-g20ff5da1ef+ff9f4b6609@Linux64.tar.gz , which is the tarball that is to be copied. That should end up at https://eups.lsst.codes/stack/redhat/el7/conda-system/miniconda3-py38_4.9.2-0.7.0/ but it is not there.
          Show
          frossie Frossie Economou added a comment - Seems there from the consoleĀ  https://s3.amazonaws.com/eups.lsst.codes/stack/redhat/el7/conda-system/miniconda3-py38_4.9.2-0.7.0/obs_base-g20ff5da1ef%2Bff9f4b6609%40Linux64.tar.gz
          Hide
          frossie Frossie Economou added a comment -

          [slack summary: we have established eups.lsst.codes serves from a PV on Google...]

          Show
          frossie Frossie Economou added a comment - [slack summary: we have established eups.lsst.codes serves from a PV on Google...]
          Hide
          ktl Kian-Tat Lim added a comment -

          I updated the disk size to 4096 GiB and the PVC to request 4 TiB, and things seem to be working again. The synchronization process from AWS S3 copied over the missing tarball even without rerunning a publish job in Jenkins.

          Show
          ktl Kian-Tat Lim added a comment - I updated the disk size to 4096 GiB and the PVC to request 4 TiB, and things seem to be working again. The synchronization process from AWS S3 copied over the missing tarball even without rerunning a publish job in Jenkins.

            People

            Assignee:
            frossie Frossie Economou
            Reporter:
            ktl Kian-Tat Lim
            Watchers:
            Frossie Economou, Kian-Tat Lim
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Jenkins

                No builds found.