[DM-10099] Upgrade Jenkins system to Blue Ocean and re-visit backlog - Jira

XML

Word

Printable

Details

Type: Epic
Status: Done
Resolution: Done
Fix Version/s: None
Component/s: Continuous Integration, Developer Infrastructure
Labels:
None

Epic Name:
sqre-s17-blue-ocean
Story Points:
60
WBS:
1.02C.10.02
Team:
SQuaRE
Cycle:
Fall 2017

Description

This epic covers an upgrade to Blue Ocean to address numerous UI grievances with Jenkins. This is a significant change in changing the stack build matrix jobs to pipelines, retiring plugins in favour of other alternatives (eg py2/py3 parallel builds) and dealing with some technical debt. Once the new system is in place, we are going to revisit the user-initiated backlog - some issues will have been addressed by the upgrade itself, and the rest will be triaged to fit the time available.

Attachments

Stories in Epic (Custom Issue Matrix)

Key	Summary	Story Points	Assignee	Status
~~DM-11624~~	convert stack-os-matrix job to jenkins pipeline	1.25	Joshua Hoblitt	Done
~~DM-11623~~	install jenkins blue ocean dashboard	0.75	Joshua Hoblitt	Done
~~DM-11616~~	weekly release w_2017_33 failed	0.25	Joshua Hoblitt	Done
~~DM-11612~~	add junit test reporting to jenkins stack-os-matrix job	6.25	Joshua Hoblitt	Done
~~DM-11746~~	jenkins remoting error on centos-6 nodes	0.125	Joshua Hoblitt	Done
~~DM-11728~~	lsst-build output not visible in jenkins console	0.5	Joshua Hoblitt	Done
~~DM-11697~~	lsstsw/bin/deploy can not recover from failed miniconda installation	0.25	Joshua Hoblitt	Done
~~DM-11692~~	artifact stack-os-matrix build .log files	2	Joshua Hoblitt	Done
~~DM-11681~~	update-cmirror job creating files with bad ownersihp	0.25	Joshua Hoblitt	Done
~~DM-11680~~	exception handling logic error in jenkins-node-cleanup job	0.25	Joshua Hoblitt	Done
~~DM-11502~~	TLS vulnerability CVE-2016-2107	2.75	Joshua Hoblitt	Done
~~DM-11488~~	weekly release w_2017_31 failed	0.5	Joshua Hoblitt	Done
~~DM-11484~~	jenkins jobs should allow - in eups distrib tag names	0.063	Joshua Hoblitt	Done
~~DM-11464~~	lsstsw does not provide a mechanism to update the lsst_build clone		Joshua Hoblitt	Done
~~DM-11444~~	newinstall.sh fails to install Miniconda	1	Joshua Hoblitt	Done
~~DM-11435~~	update eups.lsst.codes TLS cert for 2017	0.125	Joshua Hoblitt	Done
~~DM-11434~~	update {ci,squash,bokeh}.lsst.codes TLS cert for 2017	0.25	Joshua Hoblitt	Done
~~DM-11430~~	weekly release w_2017_30 failed	2.5	Joshua Hoblitt	Done
~~DM-11423~~	renew *.lsst.codes wildcard cert for 2017	0.25	Joshua Hoblitt	Done
~~DM-11406~~	jenkins unable to fetch on existing lsst/lsstsw clones	0.375	Joshua Hoblitt	Done
~~DM-11385~~	shebangtron breaks scons	1	Joshua Hoblitt	Done
~~DM-11373~~	redirect sw.lsstcorp.org -> eups.lsst.codes	2.25	Joshua Hoblitt	Done
~~DM-11337~~	Failure in image access or ingest in HSC and Decam examples	3.25	Joshua Hoblitt	Done
~~DM-11161~~	unhandled exception in jenkins-node-cleanup job	1.5	Joshua Hoblitt	Done
~~DM-11249~~	Add timer job for ci_ctio0m9	0.063	Joshua Hoblitt	Done
~~DM-11587~~	provision additional jenkins build agents for 2017 AHM	0.25	Joshua Hoblitt	Done
~~DM-11581~~	weekly release w_2017_32 failed	0.75	Joshua Hoblitt	Done
~~DM-11577~~	newinstall.sh fails if a pre-exisitng python is not in the path	2	Joshua Hoblitt	Done
~~DM-11549~~	generate "nightly" releases	1.25	Joshua Hoblitt	Done
~~DM-11304~~	switch validate_drp build to py3	0.063	Joshua Hoblitt	Done
~~DM-11286~~	automate construction of jupyterlabdemo containers	1.5	Joshua Hoblitt	Done
~~DM-10998~~	buildbot-scripts cleanups	0.5	Joshua Hoblitt	Done
~~DM-10997~~	remove dependencies on lsst package	0.125	Joshua Hoblitt	Done
~~DM-10989~~	newinstall.sh install path issues	0.75	Joshua Hoblitt	Done
~~DM-10945~~	update eups to 2.1.3 to improve tarball package installation	2	Joshua Hoblitt	Done
~~DM-10914~~	tidy jenkins top level jobs / folders	0.75	Joshua Hoblitt	Done
~~DM-10587~~	newinstall creates faulty loadLSST.csh file	0.5	Joshua Hoblitt	Done
~~DM-11024~~	migrate macpro/ESXI nodes to NOAO DC	22.5	Joshua Hoblitt	Done
~~DM-10240~~	migrate repos.yaml to a dedicated repository	3.75	Joshua Hoblitt	Done
~~DM-10140~~	lsstsw deploy failing with conda lock file errors	0.25	Joshua Hoblitt	Done
~~DM-10526~~	newinstall.sh should not default to using tarball binary packages	0.5	Joshua Hoblitt	Done
~~DM-10251~~	weekly release w_2017_16 failed due to lsstsw@lsst-dev breakage	0.5	Joshua Hoblitt	Done
~~DM-10243~~	Jenkins "my build" page showing weird extra jobs		Joshua Hoblitt	Done
~~DM-10400~~	remove jenkins osx builds	0.25	Joshua Hoblitt	Done
~~DM-10476~~	change pipeline "weekly-release" tag from Monday -> Friday	0.125	Joshua Hoblitt	Done
~~DM-10363~~	Jenkins regards lsst_dm_stack_demo failures as successes	0.125	Joshua Hoblitt	Done
~~DM-9762~~	remove buildbot references from developer guide	0.125	Joshua Hoblitt	Done
~~DM-9759~~	Please enable py3 by default in Jenkins	1.5	Joshua Hoblitt	Done
~~DM-9755~~	difficulty bringing up jenkins slaves in us-east-1	0.125	Joshua Hoblitt	Done
~~DM-8673~~	Links such as https://ci.lsst.codes/job/stack-os-matrix/19194/ are often painfully slow to open		Joshua Hoblitt	Done
~~DM-9406~~	convert jenkins to "blue ocean" UI		Joshua Hoblitt	Done
~~DM-9403~~	jenkins 2.19.4 security issues	6.75	Joshua Hoblitt	Done
~~DM-9351~~	Jenkins redirecting to incorrect build numbers	1.5	Joshua Hoblitt	Done
~~DM-9231~~	implement a fixed-length weekly tag format	0.25	Joshua Hoblitt	Done
~~DM-9448~~	run most perodic jenkins jobs outside of regular buisness hours	0.125	Joshua Hoblitt	Done
~~DM-9437~~	automate jenkins workspace cleanup	3	Joshua Hoblitt	Done
~~DM-7603~~	Please make it easier to find the console log for Jenkins builds		Joshua Hoblitt	Done
~~DM-8381~~	jenkins plugin / configuration update		Joshua Hoblitt	Done
~~DM-11493~~	weekly-release job failing with " Undefined symbol ‘choiceParam’"		Joshua Hoblitt	Invalid
~~DM-7788~~	Jenkins sometimes fails to run the demo despite being asked to run it		Joshua Hoblitt	Invalid
~~DM-8997~~	Broken links on Jenkins when mixing Python 2 and 3		Joshua Hoblitt	Invalid
~~DM-8193~~	add gcc5 to CI matrix	2.25	Joshua Hoblitt	Invalid

Activity

Ascending order - Click to sort in descending order

No builds found.

Frossie Economou created issue - 04/Apr/17 2:54 PM

Joshua Hoblitt made changes - 04/Apr/17 3:17 PM

Field	Original Value	New Value
Epic Child		~~DM-9351~~ [ 30043 ]

Joshua Hoblitt made changes - 04/Apr/17 3:21 PM

Epic Child

~~DM-9605~~ [ 30600 ]

Joshua Hoblitt made changes - 04/Apr/17 3:21 PM

Epic Child

~~DM-8193~~ [ 27704 ]

Joshua Hoblitt made changes - 04/Apr/17 3:22 PM

Epic Child

~~DM-9403~~ [ 30107 ]

Joshua Hoblitt made changes - 04/Apr/17 3:23 PM

Epic Child

~~DM-7556~~ [ 26709 ]

Joshua Hoblitt made changes - 04/Apr/17 3:24 PM

Epic Child

~~DM-9448~~ [ 30206 ]

Frossie Economou made changes - 04/Apr/17 3:34 PM

Status

To Do [ 10001 ]

In Progress [ 3 ]

Joshua Hoblitt made changes - 07/Apr/17 10:02 AM

Epic Child

~~DM-10140~~ [ 31756 ]

Joshua Hoblitt made changes - 14/Jun/17 2:40 PM

Epic Child

~~DM-9351~~ [ 30043 ]

Joshua Hoblitt made changes - 14/Jun/17 2:48 PM

Link

This issue is triggered by ~~DM-7603~~ [ ~~DM-7603~~ ]