Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-27071

butler ingest-raws crashes on one bad file

    XMLWordPrintable

    Details

    • Story Points:
      2
    • Team:
      Architecture
    • Urgent?:
      No

      Description

      In IHS-4230 it was noted that if a file fails metadata extraction the entire ingest fails.

      We need to have it ingest everything it can and then report the problematic files.

        Attachments

          Activity

          Ascending order - Click to sort in descending order
          Hide
          Permalink
          tjenness Tim Jenness added a comment -

          Jim Bosch can you take a look at this? I've added logging everywhere and now let ingest do what it can and it is only right at the end that it reports all the problems and exists with bad status.

          Show
          tjenness Tim Jenness added a comment - Jim Bosch can you take a look at this? I've added logging everywhere and now let ingest do what it can and it is only right at the end that it reports all the problems and exists with bad status.
          Hide
          Permalink
          jbosch Jim Bosch added a comment -

          Minor comments on the PR.

          Show
          jbosch Jim Bosch added a comment - Minor comments on the PR.

            People

            Assignee:
            tjenness Tim Jenness
            Reporter:
            tjenness Tim Jenness
            Reviewers:
            Jim Bosch
            Watchers:
            Eric Morganson [X] (Inactive), Jim Bosch, Tim Jenness
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Jenkins

                No builds found.