Data ManagementIcon indicating the project type

Data Management

Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-15142

Create CI-sized DECam Dataset

    XMLWordPrintable

    Details

    • Story Points:
      4
    • Epic Link:
    • Sprint:
      AP F18-2, AP F18-3, AP F18-4
    • Team:
      Alert Production

      Description

      Create a dataset (in the Reiss sense) that is a subset of ap_verify_hits2015 for use in CI. The dataset must contain multiple visits to the same location in order to test source association, and should have at most ~10 images. See discussion on #dm for more details.

      In addition to containing only a subset of raw images, the new dataset should contain only those templates that are necessary to process the subset. Unfortunately the only way I know of to figure out which templates get used is to run the pipeline and parse the log output.

        Attachments

          Issue Links

          has to be done before

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-15742 Write shell script to serve as a Jenkins hook

          • Done
          relates to

          Bug - A problem which impairs or prevents the functions of the product. DM-15224 Investigate low association rate in HiTS2015 CI dataset

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-13970 Investigate options for integrating AP with CI

          • Done

            Activity

            Ascending order - Click to sort in descending order
            11 older comments
            Hide
            Permalink
            swinbank John Swinbank added a comment -

            Hey Simon Krughoff — just a reminder of this one. Do you have an ETA on a review?

            Show
            swinbank John Swinbank added a comment - Hey Simon Krughoff — just a reminder of this one. Do you have an ETA on a review?
            Hide
            Permalink
            krzys Krzysztof Findeisen added a comment -

            On DM-15224 Meredith Rawls and I just discovered that the Blind15A_42 CCDs don't line up as expected. We'll try to figure out why they don't line up and re-submit for review then.

            Show
            krzys Krzysztof Findeisen added a comment - On DM-15224 Meredith Rawls and I just discovered that the Blind15A_42 CCDs don't line up as expected. We'll try to figure out why they don't line up and re-submit for review then.
            Hide
            Permalink
            krzys Krzysztof Findeisen added a comment -

            The problem turned out be my misreading of our maps of where the fields were located. I've changed the visit 411371 CCDs from 58 and 62 to 56 and 60; Meredith Rawls and I have verified through both ds9 inspection and running source association that these chips do overlap CCDs 5 and 10 from the other field.

            Show
            krzys Krzysztof Findeisen added a comment - The problem turned out be my misreading of our maps of where the fields were located. I've changed the visit 411371 CCDs from 58 and 62 to 56 and 60; Meredith Rawls and I have verified through both ds9 inspection and running source association that these chips do overlap CCDs 5 and 10 from the other field.
            Hide
            Permalink
            krughoff Simon Krughoff added a comment -

            This all seems good. Sorry for taking so long.

            Show
            krughoff Simon Krughoff added a comment - This all seems good. Sorry for taking so long.
            Hide
            Permalink
            krzys Krzysztof Findeisen added a comment -

            Thanks for the review!

            Show
            krzys Krzysztof Findeisen added a comment - Thanks for the review!

              People

              • Assignee:
                krzys Krzysztof Findeisen
                Reporter:
                krzys Krzysztof Findeisen
                Reviewers:
                Simon Krughoff
                Watchers:
                Eric Bellm, John Swinbank, Krzysztof Findeisen, Meredith Rawls, Simon Krughoff
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel