Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-12784

CI and build/chain/deploy improvements S18-A

    Details

    • Templates:
      SQuaRE Epic
    • Epic Name:
      sqre-s18-ci-1
    • Story Points:
      82.5
    • WBS:
      1.02C.10.02
    • Team:
      SQuaRE
    • Cycle:
      Spring 2018

      Description

      This epic covers improvements to the CI service and the build/test/deploy chain including container production for jellybean. The specific stories are negotiated between the needs of the DM teams and the operational needs of SQuaRE.

      High priority are:

      • the improvement of targeted notifications from Jenkins.
      • increasing the pool of available agents to decrease developer wait times
      • supporting the DAX team's CI-build-deploy plans

        Attachments

        Stories in Epic (Custom Issue Matrix)

        Key Summary Story Points Assignee Status
         
        DM-13311

        Create mapper for GH <-> Slack userids

        4.5 Adam Thornton Done
         
        DM-13304

        w_2018_03 release isn't

        0.25 Joshua Hoblitt Done
         
        DM-13258

        upgrade blueocean to 1.5.x

        1 Joshua Hoblitt Done
         
        DM-13239

        weekly-release w_2018_02 failed

        0.125 Joshua Hoblitt Done
         
        DM-13193

        weekly release w_2018_01 failed

        0.5 Joshua Hoblitt Done
         
        DM-13223

        jenkins nightly release generated bogus date - d_2018_12_31

        0.375 Joshua Hoblitt Done
         
        DM-13210

        migrate git-lfs server to a containerized deployment

        Joshua Hoblitt Done
         
        DM-13186

        containerize git-lfs-s3-server

        2.25 Joshua Hoblitt Done
         
        DM-13329

        jenkins @user build notifications

        1.25 Joshua Hoblitt Done
         
        DM-12945

        shapelet test failures

        0.25 Joshua Hoblitt Done
         
        DM-12911

        weekly release w_2017_48 failed

        0.375 Joshua Hoblitt Done
         
        DM-12962

        stack-os-matrix artifact files not namespaced per build configuration

        1.5 Joshua Hoblitt Done
         
        DM-12958

        allow multiple compiler strings and/or wildcard matching in LSST_COMPILER

        4.75 Joshua Hoblitt Done
         
        DM-12978

        validate_drp jenkins job failing -- using system gcc instead of devtoolset-6

        1.25 Joshua Hoblitt Done
         
        DM-12916

        run-rebuild always attempting to push docs

        0.063 Joshua Hoblitt Done
         
        DM-12815

        convert jenkins jenkins-ebs-snapshot job to pipeline

        0.5 Joshua Hoblitt Done
         
        DM-12869

        builds of lsst_distrib fail with setuptools_scm errors

        0.75 Joshua Hoblitt Done
         
        DM-12770

        jenkins ui is loading extremely slowly

        1 Joshua Hoblitt Done
         
        DM-12262

        run validate_drp via night/weekly docker images

        Joshua Hoblitt Done
         
        DM-12122

        update jenkins to 2.89.1 LTS

        0.625 Joshua Hoblitt Done
         
        DM-13716

        weekly-release w_2018_09 failed

        0.25 Joshua Hoblitt Done
         
        DM-13736

        sw.lsstcorp.org is not properly redirecting to eups.lsst.codes

        0.375 Joshua Hoblitt Done
         
        DM-13735

        git-lfs.lsst.codes - ssllabs F rating

        Joshua Hoblitt Done
         
        DM-13734

        status.lsst.codes ssllabs check broken

        1 Joshua Hoblitt Done
         
        DM-13373

        Make user mapper case-insensitive.

        0.5 Adam Thornton Done
         
        DM-13347

        update jenkins core to 2.89.3 LTS

        1.5 Joshua Hoblitt Done
         
        DM-13346

        eups install fails under jenkins when @ in a path compoent

        0.875 Joshua Hoblitt Done
         
        DM-13332

        Use ID rather than name in Slack traffic

        0.5 Adam Thornton Done
         
        DM-13413

        blueocean 1.4.0 pipeline view ignoring clicks

        1 Joshua Hoblitt Done
         
        DM-13169

        jenkins security update - spectre/meltdown

        1 Joshua Hoblitt Done
         
        DM-11633

        blueocean ui does not support ansi color codes

        0.125 Joshua Hoblitt Done
         
        DM-11631

        jenkins pipeline urls point to classic ui, not blueocean

        Joshua Hoblitt Done
         
        DM-10544

        https://lsst-web.ncsa.illinois.edu/doxygen/x_masterDoxyDoc/ 404s

        Joshua Hoblitt Done
         
        DM-11684

        blueocean ui only lists one of many queue parallel branches

        Joshua Hoblitt Done
         
        DM-10367

        Update Jenkins jobs to devtoolset-6

        15 Joshua Hoblitt Done
         
        DM-9387

        lsst_build git fetch/clone retrying

        3 Joshua Hoblitt Done
         
        DM-13858

        nightly-release d_2018_03_21 failed

        1.5 Joshua Hoblitt Done
         
        DM-13848

        update jenkins core to 2.89.4 LTS + misc plugins

        Joshua Hoblitt Done
         
        DM-13494

        lsst_build fetch errors - fatal: index file smaller than expected

        0.25 Joshua Hoblitt Done
         
        DM-13439

        jenkins update-cmirror job broken

        0.5 Joshua Hoblitt Done
         
        DM-13433

        eups.lsst.codes s3 backups failing

        0.75 Joshua Hoblitt Done
         
        DM-13431

        add a slack channel per jenkins job for notifications

        10 Joshua Hoblitt Done
         
        DM-13474

        eupspkg doxygen builds fails on lsst_distrib docker images

        1.5 Joshua Hoblitt Done
         
        DM-13644

        weekly-release w_2018_08 failed

        0.5 Joshua Hoblitt Done
         
        DM-13584

        evaluate PoC for stack pipelines.lsst.io build

        4.25 Joshua Hoblitt Done
         
        DM-13568

        nightly-release d_2018_02_15 -- some eups tarball builds failing with pip install error

        1 Joshua Hoblitt Done
         
        DM-3407

        Rename hipchat rooms

        Joshua Hoblitt Done
         
        DM-3124

        migrate from fork to an official jenkins github-oauth release

        Joshua Hoblitt Done
         
        DM-5887

        lsstswBuild.sh --print-fail flag broken

        0.5 Joshua Hoblitt Done
         
        DM-13195

        truncated jenkins build parameters

        0.125 Joshua Hoblitt Won't Fix
         
        DM-5391

        Please provide email notifications from Jenkins

        Joshua Hoblitt Won't Fix
         
        DM-8384

        jenkins plugin / configuration update

        Joshua Hoblitt Invalid
         
        DM-8383

        remove jenkins hipchat notifications

        Joshua Hoblitt Invalid
         
        DM-8380

        reorganize pipeline script directory structure

        Joshua Hoblitt Invalid
         
        DM-7962

        explore generating slack notifications external to jenkins

        Joshua Hoblitt Invalid
         
        DM-6117

        build containers using conda packages

        Joshua Hoblitt Invalid
         
        DM-3129

        selectable python version in Jenkins

        Joshua Hoblitt Invalid
         
        DM-3127

        email notification for failed builds

        Joshua Hoblitt Invalid
         
        DM-3122

        assorted jenkins improvements

        Joshua Hoblitt Invalid
         
        DM-5982

        jenkins job to tag repos for release

        Joshua Hoblitt Invalid

          Activity

            People

            • Assignee:
              jhoblitt Joshua Hoblitt
              Reporter:
              frossie Frossie Economou
              Reviewers:
              Frossie Economou
              Watchers:
              Frossie Economou
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Summary Panel