Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-14197

Make obs_test data ingestible

    XMLWordPrintable

    Details

      Description

      The data in obs_test/data/input are provided in the form of a Butler v1 repository, which is sufficient for most testing purposes. However, the files cannot be used to test ingestion code: the files have minimal (and generic) FITS headers, and cannot be ingested using default configurations for IngestTask and IngestCalibsTask.

      Known issues:

      • The flats and biases do not have an OBSTYPE header keyword, so they cannot be ingested without --calibType (or with it, given DM-13975).
      • The default config for IngestCalibsTask does not list "defect" as one of the data types to register
      • Calibration files (or just defects?) cannot use the default columns in register.unique

        Attachments

          Issue Links

          blocks

          Bug - A problem which impairs or prevents the functions of the product. DM-13849 Convert all ap_verify test data to obs_test

          • Done

            Activity

            Ascending order - Click to sort in descending order
            Hide
            Permalink
            krzys Krzysztof Findeisen added a comment -

            Hi Russell Owen, could you review this PR (and let me know if the solution I adopted is reasonable)?

            Show
            krzys Krzysztof Findeisen added a comment - Hi Russell Owen , could you review this PR (and let me know if the solution I adopted is reasonable)?
            Hide
            Permalink
            rowen Russell Owen added a comment -

            Comments on github. To summarize here: I suggest adding a few headers to the existing data files if, by doing so, you can remove some of this new machinery (especially the new task). If not, this approach presumably works and is acceptable.

            Show
            rowen Russell Owen added a comment - Comments on github. To summarize here: I suggest adding a few headers to the existing data files if, by doing so, you can remove some of this new machinery (especially the new task). If not, this approach presumably works and is acceptable.

              People

              Assignee:
              krzys Krzysztof Findeisen
              Reporter:
              krzys Krzysztof Findeisen
              Reviewers:
              Russell Owen
              Watchers:
              Krzysztof Findeisen, Russell Owen
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.