Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-27071

butler ingest-raws crashes on one bad file

    XMLWordPrintable

Details

    • 2
    • Architecture
    • No

    Description

      In IHS-4230 it was noted that if a file fails metadata extraction the entire ingest fails.

      We need to have it ingest everything it can and then report the problematic files.

      Attachments

        Activity

          tjenness Tim Jenness added a comment -

          jbosch can you take a look at this? I've added logging everywhere and now let ingest do what it can and it is only right at the end that it reports all the problems and exists with bad status.

          tjenness Tim Jenness added a comment - jbosch can you take a look at this? I've added logging everywhere and now let ingest do what it can and it is only right at the end that it reports all the problems and exists with bad status.
          jbosch Jim Bosch added a comment -

          Minor comments on the PR.

          jbosch Jim Bosch added a comment - Minor comments on the PR.

          People

            tjenness Tim Jenness
            tjenness Tim Jenness
            Jim Bosch
            Eric Morganson [X] (Inactive), Jim Bosch, Tim Jenness
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Jenkins

                No builds found.