Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-29313

FilterLabel is not properly filled in for CFHT raws

    XMLWordPrintable

    Details

    • Story Points:
      4
    • Sprint:
      AP S21-4 (March)
    • Team:
      Alert Production
    • Urgent?:
      No

      Description

      There is a bug somewhere in how the CFHT filterLabels are filled out for raw files. To demonstrate this, go to lsst-devl:/scratch/parejkoj/cfht-gen2/lsst_ci and setup the following:

      setup -kr /project/shared/data/validation_data/validation_data_cfht/
      setup -kr /project/shared/data/validation_data/validation_data_decam/
      setup -kr /project/shared/data/test_data/testdata_subaru/
      setup -kr /project/shared/data/test_data/testdata_cfht/
      setup -kr /project/shared/data/test_data/testdata_decam/
      setup -kr .
      

      You can then run python check_filterLabel.py (I'll attach a copy to this post for future reference) in that directory to get the following output:

      $ python check_filterLabel.py 
       
      ExposureF.readFits before butler import:
      afw.image.MaskedImageFitsReader WARN: Expected extension type not found: IMAGE
      FilterLabel(physical="r.MP9601")
       
      CameraMapper INFO: Loading exposure registry from /scratch/parejkoj/cfht-gen2/lsst_ci/CfhtQuick/input/registry.sqlite3
       
      ExposureF.readFits after butler creation:
      afw.image.MaskedImageFitsReader WARN: Expected extension type not found: IMAGE
      FilterLabel(band="r", physical="r.MP9601")
       
      gen2 butler.get raw:
      CameraMapper WARN: Multiple matches for filter None with data ID 'r'.
      FilterLabel(band="r")
       
      gen2 butler.get calexp:
      CameraMapper WARN: Multiple matches for filter FilterLabel(band="r") with data ID 'r'.
      FilterLabel(band="r")
      

      In particular, that middle line is interesting to me: it looks like something correct is happening when the CFHT CameraMapper registers its filters (afw readFits goes from just having physical, to having both), but then the butler isn't catching them somehow.

      I don't know if we can create gen3 CFHT repos yet, so I don't know how to test that aspect.

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              krzys Krzysztof Findeisen
              Reporter:
              Parejkoj John Parejko
              Reviewers:
              John Parejko
              Watchers:
              Ian Sullivan, John Parejko, Krzysztof Findeisen, Tim Jenness
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.