Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-25734

Do not attempt to scan non-FITS files in obs_decam instcal ingest

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Won't Fix
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: obs_decam
    • Labels:
      None

      Description

      As noted in https://community.lsst.org/t/decam-mosaic-ingestion-error/4233, obs_decam raw ingest scans the instcal, dqmask, and wtmap directories for exposures. It assumes that all files in those directories are exposures, which is not always the case. In this case, a macOS .DS_Store file failed to be scanned.

      A modification to the code around https://github.com/lsst/obs_decam/blob/master/python/lsst/obs/decam/ingest.py#L136, either filtering to only process FITS filenames or handling any failures from readMetadata(), would fix this.

        Attachments

          Activity

          Hide
          mrawls Meredith Rawls added a comment -

          It is worth mentioning that this is not raw ingest, this is instcal ingest, which is not the default mode of use (actual raw ingest). Agreed this is likely a quick fix, but there are a whole bunch of idiosyncratic things in how we handle DECam instcals which it may open up.

          Show
          mrawls Meredith Rawls added a comment - It is worth mentioning that this is not raw ingest, this is instcal ingest, which is not the default mode of use (actual raw ingest). Agreed this is likely a quick fix, but there are a whole bunch of idiosyncratic things in how we handle DECam instcals which it may open up.
          Hide
          tjenness Tim Jenness added a comment -

          This is also gen2 specific.

          Show
          tjenness Tim Jenness added a comment - This is also gen2 specific.
          Hide
          tjenness Tim Jenness added a comment -

          This is gen2 specific. Ingest with gen3 of other types of DECam products created externally can be a new ticket if required.

          Show
          tjenness Tim Jenness added a comment - This is gen2 specific. Ingest with gen3 of other types of DECam products created externally can be a new ticket if required.

            People

            Assignee:
            Unassigned Unassigned
            Reporter:
            ktl Kian-Tat Lim
            Watchers:
            Kian-Tat Lim, Meredith Rawls, Tim Jenness
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Jenkins

                No builds found.