Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-18634

CI chain improvements and supprt

    Details

    • Type: Epic
    • Status: In Progress
    • Resolution: Unresolved
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Epic Name:
      sqre-s19-ci-2
    • Story Points:
      22.5
    • WBS:
      1.02C.10.02
    • Team:
      SQuaRE
    • Cycle:
      Spring 2019

      Description

      This epic covers improvements to the CI service and its underlying infrastructure. It includes:

      • A transition to k8s to allow us to consolidate our services to Kubernetes-based infrastructure
      • Security updates to services
      • Expanding Mac capacity

        Attachments

        Stories in Epic (Custom Issue Matrix)

        Key Summary Story Points Assignee Status
        DM-20028

        eups.lsst.codes pkgroot volume is running out of space

        Joshua Hoblitt To Do
        DM-19552

        CI pipeline dax / docker / build-dev failing

        Joshua Hoblitt To Do
        DM-19338

        jenkins master running out of disk space

        0.125 Joshua Hoblitt To Do
        DM-18599

        ap_verify jenkins pipeline does not set PRODUCT env variable

        0.25 Joshua Hoblitt To Do
        DM-18623

        migrate jenkins to java 11

        Joshua Hoblitt To Do
        DM-21113

        renew *.lsst.codes wildcard cert 2019

        0.375 Joshua Hoblitt In Progress
        DM-20229

        migrate jenkins master deployment to k8s

        Joshua Hoblitt In Progress
         
        DM-20498

        lsstsw rebuild 18.0.0 fails

        0.5 Joshua Hoblitt Done
         
        DM-20485

        expose kubernetes node name/etc. in jenkins build logs

        2.5 Unassigned Done
         
        DM-20444

        jenkins pipeline retry{} block not repeating upon failure

        0.625 Joshua Hoblitt Done
         
        DM-20280

        jenkins agent-ldfc-0 did not come back online after NCSA 06/23 maintaince

        0.5 Joshua Hoblitt Done
         
        DM-20264

        Test Jenkins required

        1 Joshua Hoblitt Done
         
        DM-20253

        up/down monitoring for efd2.lsst.codes is flapping

        7.5 Joshua Hoblitt Done
         
        DM-20252

        jenkins docker builds failing on agent-ldfc-3/lsst-kub017

        0.25 Unassigned Done
         
        DM-20001

        migrate jenkins secrets to vault

        13 Joshua Hoblitt Done
         
        DM-23019

        Jenkins no longer communicates with slack

        0.25 Joshua Hoblitt Done
         
        DM-22595

        change jenkins ldfc agent nfs mount paths

        0.25 Joshua Hoblitt Done
         
        DM-23051

        prod jenkins ec2 instance needs to be restarted

        0.125 Joshua Hoblitt Done
         
        DM-21844

        mv lsst-sqre/jenkins-dm-jobs -> lsst-dm/jenkins-dm-jobs

        0.25 Joshua Hoblitt Done
         
        DM-19821

        Mac Jenkins nodes in Tucson cannot find GitHub

        Frossie Economou Done
         
        DM-19774

        factor gke setup out of existing efd-kafka production deployment

        1 Joshua Hoblitt Done
         
        DM-19772

        SQRE network routing reconfig post NOAO core changes

        1 Joshua Hoblitt Done
         
        DM-19726

        update efd-kafka prometheus deployment

        3 Joshua Hoblitt Done
         
        DM-19696

        add 3x new maciminis to DM jenkins

        3.5 Joshua Hoblitt Done
         
        DM-19675

        Retire sw.lsstcorp.org domain name

        0.438 Joshua Hoblitt Done
         
        DM-19490

        Resurrect status.lsst.codes

        4 Adam Thornton Done
         
        DM-19465

        Add vault healthcheck endpoint to monitoring

        0.5 Adam Thornton Done
         
        DM-19231

        jenkins 2019-04-10 security advisory

        0.187 Joshua Hoblitt Done
         
        DM-18916

        newinstall.sh osx compiler string is incorrect after switch to mojave builds

        0.25 Joshua Hoblitt Done
         
        DM-18733

        Remove Jenkins pipeline dax/docker/build-release

        0.042 Joshua Hoblitt Done
         
        DM-18781

        Mojave on jenkins are failing to find pip

        1 Joshua Hoblitt Done
         
        DM-18696

        provide mechanism for user triggered job workspace cleanup

        3.5 Joshua Hoblitt Done
         
        DM-21502

        DM jenkins master low disk space

        0.375 Joshua Hoblitt Done
         
        DM-18349

        d_2019_03_08 failed due to docker hub http 500

        0.25 Joshua Hoblitt Done
         
        DM-17945

        jenkins 2019-01-16..2019-03-06 security advisories

        2.5 Joshua Hoblitt Done
         
        DM-18361

        devtoolset-8 dax-matrix build

        0.25 Joshua Hoblitt Done
         
        DM-18373

        error generating v17.0.1.rc1

        0.25 Joshua Hoblitt Done
         
        DM-18679

        Turn off macOS builds until they can build stack again

        0.25 Joshua Hoblitt Done
         
        DM-18618

        jenkins 2019-03-25 security advisory

        1 Joshua Hoblitt Done
         
        DM-15039

        Codekit fails to run when $DM_SQUARE_DEBUG is set

        0.375 Joshua Hoblitt Done
         
        DM-13882

        add high sierra (osx 10.13) to jenkins build env

        4.5 Joshua Hoblitt Done
         
        DM-19537

        Remove sw.lsstcorp.org from monitoring

        0.5 Adam Thornton Won't Fix

          Activity

          There are no comments yet on this issue.

            People

            • Assignee:
              jhoblitt Joshua Hoblitt
              Reporter:
              frossie Frossie Economou
              Watchers:
              Frossie Economou
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:

                Summary Panel