Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-12784

CI and build/chain/deploy improvements S18-A

    Details

    • Templates:
      SQuaRE Epic
    • Epic Name:
      sqre-s18-ci-1
    • Story Points:
      82.5
    • WBS:
      1.02C.10.02
    • Team:
      SQuaRE
    • Cycle:
      Spring 2018

      Description

      This epic covers improvements to the CI service and the build/test/deploy chain including container production for jellybean. The specific stories are negotiated between the needs of the DM teams and the operational needs of SQuaRE.

      High priority are:

      • the improvement of targeted notifications from Jenkins.
      • increasing the pool of available agents to decrease developer wait times
      • supporting the DAX team's CI-build-deploy plans

        Attachments

          Container Issues

          Stories in Epic (Custom Issue Matrix)

          Key Summary Story Points Assignee Status
           
          DM-13494

          lsst_build fetch errors - fatal: index file smaller than expected

          0.25 Joshua Hoblitt Done
           
          DM-13568

          nightly-release d_2018_02_15 -- some eups tarball builds failing with pip install error

          1 Joshua Hoblitt Done
           
          DM-13413

          blueocean 1.4.0 pipeline view ignoring clicks

          1 Joshua Hoblitt Done
           
          DM-13439

          jenkins update-cmirror job broken

          0.5 Joshua Hoblitt Done
           
          DM-13433

          eups.lsst.codes s3 backups failing

          0.75 Joshua Hoblitt Done
           
          DM-13474

          eupspkg doxygen builds fails on lsst_distrib docker images

          1.5 Joshua Hoblitt Done
           
          DM-13431

          add a slack channel per jenkins job for notifications

          10 Joshua Hoblitt Done
           
          DM-12815

          convert jenkins jenkins-ebs-snapshot job to pipeline

          0.5 Joshua Hoblitt Done
           
          DM-12962

          stack-os-matrix artifact files not namespaced per build configuration

          1.5 Joshua Hoblitt Done
           
          DM-12958

          allow multiple compiler strings and/or wildcard matching in LSST_COMPILER

          4.75 Joshua Hoblitt Done
           
          DM-12945

          shapelet test failures

          0.25 Joshua Hoblitt Done
           
          DM-12916

          run-rebuild always attempting to push docs

          0.063 Joshua Hoblitt Done
           
          DM-12911

          weekly release w_2017_48 failed

          0.375 Joshua Hoblitt Done
           
          DM-12869

          builds of lsst_distrib fail with setuptools_scm errors

          0.75 Joshua Hoblitt Done
           
          DM-12770

          jenkins ui is loading extremely slowly

          1 Joshua Hoblitt Done
           
          DM-12978

          validate_drp jenkins job failing -- using system gcc instead of devtoolset-6

          1.25 Joshua Hoblitt Done
           
          DM-13644

          weekly-release w_2018_08 failed

          0.5 Joshua Hoblitt Done
           
          DM-13858

          nightly-release d_2018_03_21 failed

          1.5 Joshua Hoblitt Done
           
          DM-13848

          update jenkins core to 2.89.4 LTS + misc plugins

          Joshua Hoblitt Done
           
          DM-13716

          weekly-release w_2018_09 failed

          0.25 Joshua Hoblitt Done
           
          DM-13736

          sw.lsstcorp.org is not properly redirecting to eups.lsst.codes

          0.375 Joshua Hoblitt Done
           
          DM-13735

          git-lfs.lsst.codes - ssllabs F rating

          Joshua Hoblitt Done
           
          DM-13734

          status.lsst.codes ssllabs check broken

          1 Joshua Hoblitt Done
           
          DM-13584

          evaluate PoC for stack pipelines.lsst.io build

          4.25 Joshua Hoblitt Done
           
          DM-13304

          w_2018_03 release isn't

          0.25 Joshua Hoblitt Done
           
          DM-13258

          upgrade blueocean to 1.5.x

          1 Joshua Hoblitt Done
           
          DM-13186

          containerize git-lfs-s3-server

          2.25 Joshua Hoblitt Done
           
          DM-13169

          jenkins security update - spectre/meltdown

          1 Joshua Hoblitt Done
           
          DM-13239

          weekly-release w_2018_02 failed

          0.125 Joshua Hoblitt Done
           
          DM-13223

          jenkins nightly release generated bogus date - d_2018_12_31

          0.375 Joshua Hoblitt Done
           
          DM-13347

          update jenkins core to 2.89.3 LTS

          1.5 Joshua Hoblitt Done
           
          DM-13346

          eups install fails under jenkins when @ in a path compoent

          0.875 Joshua Hoblitt Done
           
          DM-13332

          Use ID rather than name in Slack traffic

          0.5 Adam Thornton Done
           
          DM-13329

          jenkins @user build notifications

          1.25 Joshua Hoblitt Done
           
          DM-13311

          Create mapper for GH <-> Slack userids

          4.5 Adam Thornton Done
           
          DM-13210

          migrate git-lfs server to a containerized deployment

          Joshua Hoblitt Done
           
          DM-13193

          weekly release w_2018_01 failed

          0.5 Joshua Hoblitt Done
           
          DM-13373

          Make user mapper case-insensitive.

          0.5 Adam Thornton Done
           
          DM-11684

          blueocean ui only lists one of many queue parallel branches

          Joshua Hoblitt Done
           
          DM-11633

          blueocean ui does not support ansi color codes

          0.125 Joshua Hoblitt Done
           
          DM-11631

          jenkins pipeline urls point to classic ui, not blueocean

          Joshua Hoblitt Done
           
          DM-12122

          update jenkins to 2.89.1 LTS

          0.625 Joshua Hoblitt Done
           
          DM-12262

          run validate_drp via night/weekly docker images

          Joshua Hoblitt Done
           
          DM-9387

          lsst_build git fetch/clone retrying

          3 Joshua Hoblitt Done
           
          DM-5887

          lsstswBuild.sh --print-fail flag broken

          0.5 Joshua Hoblitt Done
           
          DM-10367

          Update Jenkins jobs to devtoolset-6

          15 Joshua Hoblitt Done
           
          DM-10544

          https://lsst-web.ncsa.illinois.edu/doxygen/x_masterDoxyDoc/ 404s

          Joshua Hoblitt Done
           
          DM-3124

          migrate from fork to an official jenkins github-oauth release

          Joshua Hoblitt Done
           
          DM-3407

          Rename hipchat rooms

          Joshua Hoblitt Done
           
          DM-13195

          truncated jenkins build parameters

          0.125 Joshua Hoblitt Won't Fix
           
          DM-5391

          Please provide email notifications from Jenkins

          Joshua Hoblitt Won't Fix
           
          DM-8384

          jenkins plugin / configuration update

          Joshua Hoblitt Invalid
           
          DM-8383

          remove jenkins hipchat notifications

          Joshua Hoblitt Invalid
           
          DM-8380

          reorganize pipeline script directory structure

          Joshua Hoblitt Invalid
           
          DM-6117

          build containers using conda packages

          Joshua Hoblitt Invalid
           
          DM-5982

          jenkins job to tag repos for release

          Joshua Hoblitt Invalid
           
          DM-7962

          explore generating slack notifications external to jenkins

          Joshua Hoblitt Invalid
           
          DM-3129

          selectable python version in Jenkins

          Joshua Hoblitt Invalid
           
          DM-3127

          email notification for failed builds

          Joshua Hoblitt Invalid
           
          DM-3122

          assorted jenkins improvements

          Joshua Hoblitt Invalid

            Activity

              People

              • Assignee:
                jhoblitt Joshua Hoblitt
                Reporter:
                frossie Frossie Economou
                Reviewers:
                Frossie Economou
                Watchers:
                Frossie Economou
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel