Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-18892

Investigate deletes in Gen3 ci_hsc conversion or processing

    XMLWordPrintable

    Details

    • Story Points:
      1
    • Team:
      Data Release Production

      Description

      From Michelle Gower at https://lsstc.slack.com/archives/C2JPT1KB7/p1553801514017200:

      For each run there were a bunch of
      ```DELETE FROM "PatchSkyPixJoin" WHERE "PatchSkyPixJoin".tract = :tract_1 AND "PatchSkyPixJoin".skymap = :skymap_1 AND "PatchSkyPixJoin".patch = :patch_1```
      statements which at first glance seem to be coming from the pipeline. If they are from the pipeline (instead of the gen3.py or other bootstrap codes), then we should talk sometime about why there is a delete.

      These tables should be inserted into in gen2convert, but not deleted from.  They should not be modified at all during processing.  It's possible I'm just clearing subset of a table before inserting into it, which would mean in this case these DELETEs are no-ops because there are no matching record.  If that's the case, we might be able to ignore this.

        Attachments

          Issue Links

            Activity

            No work has yet been logged on this issue.

              People

              Assignee:
              jbosch Jim Bosch
              Reporter:
              jbosch Jim Bosch
              Watchers:
              Christopher Stephens [X] (Inactive), Jim Bosch, Michelle Gower
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.