Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-10099

Upgrade Jenkins system to Blue Ocean and re-visit backlog

    XMLWordPrintable

    Details

    • Epic Name:
      sqre-s17-blue-ocean
    • Story Points:
      60
    • WBS:
      1.02C.10.02
    • Team:
      SQuaRE
    • Cycle:
      Fall 2017

      Description

      This epic covers an upgrade to Blue Ocean to address numerous UI grievances with Jenkins. This is a significant change in changing the stack build matrix jobs to pipelines, retiring plugins in favour of other alternatives (eg py2/py3 parallel builds) and dealing with some technical debt. Once the new system is in place, we are going to revisit the user-initiated backlog - some issues will have been addressed by the upgrade itself, and the rest will be triaged to fit the time available.

        Attachments

        Stories in Epic (Custom Issue Matrix)

        Key Summary Story Points Assignee Status
         
        		DM-11624

        convert stack-os-matrix job to jenkins pipeline

        		 1.25 Joshua Hoblitt Done
         
        		DM-11623

        install jenkins blue ocean dashboard

        		 0.75 Joshua Hoblitt Done
         
        		DM-11616

        weekly release w_2017_33 failed

        		 0.25 Joshua Hoblitt Done
         
        		DM-11612

        add junit test reporting to jenkins stack-os-matrix job

        		 6.25 Joshua Hoblitt Done
         
        		DM-11746

        jenkins remoting error on centos-6 nodes

        		 0.125 Joshua Hoblitt Done
         
        		DM-11728

        lsst-build output not visible in jenkins console

        		 0.5 Joshua Hoblitt Done
         
        		DM-11697

        lsstsw/bin/deploy can not recover from failed miniconda installation

        		 0.25 Joshua Hoblitt Done
         
        		DM-11692

        artifact stack-os-matrix build .log files

        		 2 Joshua Hoblitt Done
         
        		DM-11681

        update-cmirror job creating files with bad ownersihp

        		 0.25 Joshua Hoblitt Done
         
        		DM-11680

        exception handling logic error in jenkins-node-cleanup job

        		 0.25 Joshua Hoblitt Done
         
        		DM-11502

        TLS vulnerability CVE-2016-2107

        		 2.75 Joshua Hoblitt Done
         
        		DM-11488

        weekly release w_2017_31 failed

        		 0.5 Joshua Hoblitt Done
         
        		DM-11484

        jenkins jobs should allow - in eups distrib tag names

        		 0.063 Joshua Hoblitt Done
         
        		DM-11464

        lsstsw does not provide a mechanism to update the lsst_build clone

        		 Joshua Hoblitt Done
         
        		DM-11444

        newinstall.sh fails to install Miniconda

        		 1 Joshua Hoblitt Done
         
        		DM-11435

        update eups.lsst.codes TLS cert for 2017

        		 0.125 Joshua Hoblitt Done
         
        		DM-11434

        update {ci,squash,bokeh}.lsst.codes TLS cert for 2017

        		 0.25 Joshua Hoblitt Done
         
        		DM-11430

        weekly release w_2017_30 failed

        		 2.5 Joshua Hoblitt Done
         
        		DM-11423

        renew *.lsst.codes wildcard cert for 2017

        		 0.25 Joshua Hoblitt Done
         
        		DM-11406

        jenkins unable to fetch on existing lsst/lsstsw clones

        		 0.375 Joshua Hoblitt Done
         
        		DM-11385

        shebangtron breaks scons

        		 1 Joshua Hoblitt Done
         
        		DM-11373

        redirect sw.lsstcorp.org -> eups.lsst.codes

        		 2.25 Joshua Hoblitt Done
         
        		DM-11337

        Failure in image access or ingest in HSC and Decam examples

        		 3.25 Joshua Hoblitt Done
         
        		DM-11161

        unhandled exception in jenkins-node-cleanup job

        		 1.5 Joshua Hoblitt Done
         
        		DM-11249

        Add timer job for ci_ctio0m9

        		 0.063 Joshua Hoblitt Done
         
        		DM-11587

        provision additional jenkins build agents for 2017 AHM

        		 0.25 Joshua Hoblitt Done
         
        		DM-11581

        weekly release w_2017_32 failed

        		 0.75 Joshua Hoblitt Done
         
        		DM-11577

        newinstall.sh fails if a pre-exisitng python is not in the path

        		 2 Joshua Hoblitt Done
         
        		DM-11549

        generate "nightly" releases

        		 1.25 Joshua Hoblitt Done
         
        		DM-11304

        switch validate_drp build to py3

        		 0.063 Joshua Hoblitt Done
         
        		DM-11286

        automate construction of jupyterlabdemo containers

        		 1.5 Joshua Hoblitt Done
         
        		DM-10998

        buildbot-scripts cleanups

        		 0.5 Joshua Hoblitt Done
         
        		DM-10997

        remove dependencies on lsst package

        		 0.125 Joshua Hoblitt Done
         
        		DM-10989

        newinstall.sh install path issues

        		 0.75 Joshua Hoblitt Done
         
        		DM-10945

        update eups to 2.1.3 to improve tarball package installation

        		 2 Joshua Hoblitt Done
         
        		DM-10914

        tidy jenkins top level jobs / folders

        		 0.75 Joshua Hoblitt Done
         
        		DM-10587

        newinstall creates faulty loadLSST.csh file

        		0.5 Joshua Hoblitt Done
         
        		DM-11024

        migrate macpro/ESXI nodes to NOAO DC

        		 22.5 Joshua Hoblitt Done
         
        		DM-10240

        migrate repos.yaml to a dedicated repository

        		 3.75 Joshua Hoblitt Done
         
        		DM-10140

        lsstsw deploy failing with conda lock file errors

        		 0.25 Joshua Hoblitt Done
         
        		DM-10526

        newinstall.sh should not default to using tarball binary packages

        		 0.5 Joshua Hoblitt Done
         
        		DM-10251

        weekly release w_2017_16 failed due to lsstsw@lsst-dev breakage

        		 0.5 Joshua Hoblitt Done
         
        		DM-10243

        Jenkins "my build" page showing weird extra jobs

        		 Joshua Hoblitt Done
         
        		DM-10400

        remove jenkins osx builds

        		 0.25 Joshua Hoblitt Done
         
        		DM-10476

        change pipeline "weekly-release" tag from Monday -> Friday

        		 0.125 Joshua Hoblitt Done
         
        		DM-10363

        Jenkins regards lsst_dm_stack_demo failures as successes

        		 0.125 Joshua Hoblitt Done
         
        		DM-9762

        remove buildbot references from developer guide

        		 0.125 Joshua Hoblitt Done
         
        		DM-9759

        Please enable py3 by default in Jenkins

        		 1.5 Joshua Hoblitt Done
         
        		DM-9755

        difficulty bringing up jenkins slaves in us-east-1

        		 0.125 Joshua Hoblitt Done
         
        		DM-8673

        Links such as https://ci.lsst.codes/job/stack-os-matrix/19194/ are often painfully slow to open

        		 Joshua Hoblitt Done
         
        		DM-9406

        convert jenkins to "blue ocean" UI

        		 Joshua Hoblitt Done
         
        		DM-9403

        jenkins 2.19.4 security issues

        		 6.75 Joshua Hoblitt Done
         
        		DM-9351

        Jenkins redirecting to incorrect build numbers

        		 1.5 Joshua Hoblitt Done
         
        		DM-9231

        implement a fixed-length weekly tag format

        		 0.25 Joshua Hoblitt Done
         
        		DM-9448

        run most perodic jenkins jobs outside of regular buisness hours

        		 0.125 Joshua Hoblitt Done
         
        		DM-9437

        automate jenkins workspace cleanup

        		 3 Joshua Hoblitt Done
         
        		DM-7603

        Please make it easier to find the console log for Jenkins builds

        		 Joshua Hoblitt Done
         
        		DM-8381

        jenkins plugin / configuration update

        		 Joshua Hoblitt Done
         
        		DM-11493

        weekly-release job failing with " Undefined symbol ‘choiceParam’"

        		 Joshua Hoblitt Invalid
         
        		DM-7788

        Jenkins sometimes fails to run the demo despite being asked to run it

        		 Joshua Hoblitt Invalid
         
        		DM-8997

        Broken links on Jenkins when mixing Python 2 and 3

        		 Joshua Hoblitt Invalid
         
        		DM-8193

        add gcc5 to CI matrix

        		 2.25 Joshua Hoblitt Invalid

          Activity

          Ascending order - Click to sort in descending order
          Hide
          Permalink
          frossie Frossie Economou added a comment -

          SIgnificant CI upgrades and build issues were resolved as part of this epic.

          Show
          frossie Frossie Economou added a comment - SIgnificant CI upgrades and build issues were resolved as part of this epic.
          Hide
          Permalink
          frossie Frossie Economou added a comment -

          All work is live and deployed on ci.lsst.codes

          Show
          frossie Frossie Economou added a comment - All work is live and deployed on ci.lsst.codes

            People

            Assignee:
            jhoblitt Joshua Hoblitt
            Reporter:
            frossie Frossie Economou
            Reviewers:
            Frossie Economou
            Watchers:
            Frossie Economou
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Jenkins

                No builds found.