Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-10099

Upgrade Jenkins system to Blue Ocean and re-visit backlog

    Details

    • Templates:
      SQuaRE Epic
    • Epic Name:
      sqre-s17-blue-ocean
    • Story Points:
      60
    • WBS:
      1.02C.10.02
    • Team:
      SQuaRE
    • Cycle:
      Fall 2017

      Description

      This epic covers an upgrade to Blue Ocean to address numerous UI grievances with Jenkins. This is a significant change in changing the stack build matrix jobs to pipelines, retiring plugins in favour of other alternatives (eg py2/py3 parallel builds) and dealing with some technical debt. Once the new system is in place, we are going to revisit the user-initiated backlog - some issues will have been addressed by the upgrade itself, and the rest will be triaged to fit the time available.

        Attachments

          Container Issues

          Stories in Epic (Custom Issue Matrix)

          Key Summary Story Points Assignee Status
           
          DM-7603

          Please make it easier to find the console log for Jenkins builds

          Joshua Hoblitt Done
           
          DM-8673

          Links such as https://ci.lsst.codes/job/stack-os-matrix/19194/ are often painfully slow to open

          Joshua Hoblitt Done
           
          DM-8381

          jenkins plugin / configuration update

          Joshua Hoblitt Done
           
          DM-11746

          jenkins remoting error on centos-6 nodes

          0.125 Joshua Hoblitt Done
           
          DM-11612

          add junit test reporting to jenkins stack-os-matrix job

          6.25 Joshua Hoblitt Done
           
          DM-11587

          provision additional jenkins build agents for 2017 AHM

          0.25 Joshua Hoblitt Done
           
          DM-11581

          weekly release w_2017_32 failed

          0.75 Joshua Hoblitt Done
           
          DM-11577

          newinstall.sh fails if a pre-exisitng python is not in the path

          2 Joshua Hoblitt Done
           
          DM-11502

          TLS vulnerability CVE-2016-2107

          2.75 Joshua Hoblitt Done
           
          DM-11484

          jenkins jobs should allow - in eups distrib tag names

          0.063 Joshua Hoblitt Done
           
          DM-11488

          weekly release w_2017_31 failed

          0.5 Joshua Hoblitt Done
           
          DM-11435

          update eups.lsst.codes TLS cert for 2017

          0.125 Joshua Hoblitt Done
           
          DM-11444

          newinstall.sh fails to install Miniconda

          1 Joshua Hoblitt Done
           
          DM-11434

          update {ci,squash,bokeh}.lsst.codes TLS cert for 2017

          0.25 Joshua Hoblitt Done
           
          DM-11430

          weekly release w_2017_30 failed

          2.5 Joshua Hoblitt Done
           
          DM-11423

          renew *.lsst.codes wildcard cert for 2017

          0.25 Joshua Hoblitt Done
           
          DM-11406

          jenkins unable to fetch on existing lsst/lsstsw clones

          0.375 Joshua Hoblitt Done
           
          DM-11337

          Failure in image access or ingest in HSC and Decam examples

          3.25 Joshua Hoblitt Done
           
          DM-11304

          switch validate_drp build to py3

          0.063 Joshua Hoblitt Done
           
          DM-11286

          automate construction of jupyterlabdemo containers

          1.5 Joshua Hoblitt Done
           
          DM-11249

          Add timer job for ci_ctio0m9

          0.063 Joshua Hoblitt Done
           
          DM-11161

          unhandled exception in jenkins-node-cleanup job

          1.5 Joshua Hoblitt Done
           
          DM-11024

          migrate macpro/ESXI nodes to NOAO DC

          22.5 Joshua Hoblitt Done
           
          DM-10998

          buildbot-scripts cleanups

          0.5 Joshua Hoblitt Done
           
          DM-10997

          remove dependencies on lsst package

          0.125 Joshua Hoblitt Done
           
          DM-10945

          update eups to 2.1.3 to improve tarball package installation

          2 Joshua Hoblitt Done
           
          DM-10914

          tidy jenkins top level jobs / folders

          0.75 Joshua Hoblitt Done
           
          DM-11728

          lsst-build output not visible in jenkins console

          0.5 Joshua Hoblitt Done
           
          DM-11692

          artifact stack-os-matrix build .log files

          2 Joshua Hoblitt Done
           
          DM-11697

          lsstsw/bin/deploy can not recover from failed miniconda installation

          0.25 Joshua Hoblitt Done
           
          DM-11680

          exception handling logic error in jenkins-node-cleanup job

          0.25 Joshua Hoblitt Done
           
          DM-11681

          update-cmirror job creating files with bad ownersihp

          0.25 Joshua Hoblitt Done
           
          DM-11623

          install jenkins blue ocean dashboard

          0.75 Joshua Hoblitt Done
           
          DM-11616

          weekly release w_2017_33 failed

          0.25 Joshua Hoblitt Done
           
          DM-11549

          generate "nightly" releases

          1.25 Joshua Hoblitt Done
           
          DM-11464

          lsstsw does not provide a mechanism to update the lsst_build clone

          Joshua Hoblitt Done
           
          DM-11373

          redirect sw.lsstcorp.org -> eups.lsst.codes

          2.25 Joshua Hoblitt Done
           
          DM-10363

          Jenkins regards lsst_dm_stack_demo failures as successes

          0.125 Joshua Hoblitt Done
           
          DM-10140

          lsstsw deploy failing with conda lock file errors

          0.25 Joshua Hoblitt Done
           
          DM-9762

          remove buildbot references from developer guide

          0.125 Joshua Hoblitt Done
           
          DM-9759

          Please enable py3 by default in Jenkins

          1.5 Joshua Hoblitt Done
           
          DM-9755

          difficulty bringing up jenkins slaves in us-east-1

          0.125 Joshua Hoblitt Done
           
          DM-9448

          run most perodic jenkins jobs outside of regular buisness hours

          0.125 Joshua Hoblitt Done
           
          DM-9437

          automate jenkins workspace cleanup

          3 Joshua Hoblitt Done
           
          DM-9406

          convert jenkins to "blue ocean" UI

          Joshua Hoblitt Done
           
          DM-9403

          jenkins 2.19.4 security issues

          6.75 Joshua Hoblitt Done
           
          DM-9351

          Jenkins redirecting to incorrect build numbers

          1.5 Joshua Hoblitt Done
           
          DM-10476

          change pipeline "weekly-release" tag from Monday -> Friday

          0.125 Joshua Hoblitt Done
           
          DM-10400

          remove jenkins osx builds

          0.25 Joshua Hoblitt Done
           
          DM-10251

          weekly release w_2017_16 failed due to lsstsw@lsst-dev breakage

          0.5 Joshua Hoblitt Done
           
          DM-10243

          Jenkins "my build" page showing weird extra jobs

          Joshua Hoblitt Done
           
          DM-10587

          newinstall creates faulty loadLSST.csh file

          0.5 Joshua Hoblitt Done
           
          DM-10526

          newinstall.sh should not default to using tarball binary packages

          0.5 Joshua Hoblitt Done
           
          DM-10240

          migrate repos.yaml to a dedicated repository

          3.75 Joshua Hoblitt Done
           
          DM-9231

          implement a fixed-length weekly tag format

          0.25 Joshua Hoblitt Done
           
          DM-11624

          convert stack-os-matrix job to jenkins pipeline

          1.25 Joshua Hoblitt Done
           
          DM-11385

          shebangtron breaks scons

          1 Joshua Hoblitt Done
           
          DM-10989

          newinstall.sh install path issues

          0.75 Joshua Hoblitt Done
           
          DM-8193

          add gcc5 to CI matrix

          2.25 Joshua Hoblitt Invalid
           
          DM-8997

          Broken links on Jenkins when mixing Python 2 and 3

          Joshua Hoblitt Invalid
           
          DM-7788

          Jenkins sometimes fails to run the demo despite being asked to run it

          Joshua Hoblitt Invalid
           
          DM-11493

          weekly-release job failing with " Undefined symbol ‘choiceParam’"

          Joshua Hoblitt Invalid

            Activity

              People

              • Assignee:
                jhoblitt Joshua Hoblitt
                Reporter:
                frossie Frossie Economou
                Reviewers:
                Frossie Economou
                Watchers:
                Frossie Economou
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel