Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-27507

Please add ability to skip some files when ingesting data

    XMLWordPrintable

    Details

    • Type: Story
    • Status: To Do
    • Resolution: Unresolved
    • Fix Version/s: None
    • Component/s: obs_base
    • Labels:
    • Team:
      Architecture
    • Urgent?:
      No

      Description

      There are some image files that should not be ingested. For example, data taken at SLAC with the BOT that are not part of official runs may be missing e.g. EXPTIME and should be ignored.

      Please provide a way to list known-bad files that should be skipped, and also a way to identify bad files as they are processed (e.g. no RUN keyword) and ignore them too, without generating warnings. Ideally there'd be a way to add such files to the skip list in case we need to reingest.

        Attachments

          Activity

          There are no comments yet on this issue.

            People

            Assignee:
            Unassigned Unassigned
            Reporter:
            rhl Robert Lupton
            Watchers:
            Robert Lupton
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated:

                Jenkins Builds

                No builds found.