Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-9694

run validate_drp chft/decam datasets multiple times per day

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Won't Fix
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      The chft/decam datasets have much shorter run times than hsc. It has been proposed that we run the faster datasets more frequently while leaving the interval for the hsc dataset at once per day.

      Supporting this will require refactoring the validate_drp jenkins job.

        Attachments

          Issue Links

            Activity

            Hide
            ktl Kian-Tat Lim added a comment -

            It's not clear that this is still desirable.  There might be work needed downstream in SQuaSH to handle increased frequency or branch labels if validate_drp were to be run on push/PR.  Modifying the Jenkins job would also take at least a little effort to split into separate pipelines for each frequency.  As long as the number of changes that would affect metrics is relatively low and the latency to problem detection is adequate, we'd prefer to leave this as is.

            Show
            ktl Kian-Tat Lim added a comment - It's not clear that this is still desirable.  There might be work needed downstream in SQuaSH to handle increased frequency or branch labels if validate_drp were to be run on push/PR.  Modifying the Jenkins job would also take at least a little effort to split into separate pipelines for each frequency.  As long as the number of changes that would affect metrics is relatively low and the latency to problem detection is adequate, we'd prefer to leave this as is.

              People

              Assignee:
              jhoblitt Joshua Hoblitt
              Reporter:
              jhoblitt Joshua Hoblitt
              Watchers:
              Angelo Fausti, Jonathan Sick, Joshua Hoblitt, Kian-Tat Lim, Michael Wood-Vasey
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.