Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-10161

Remove maxtasksperchild=1 during pool initialization in meas_mosaic

    XMLWordPrintable

Details

    • Bug
    • Status: Done
    • Resolution: Done
    • None
    • meas_mosaic
    • None
    • 1
    • DRP S17-5
    • Data Release Production

    Description

      Testing for DM-10043 has revealed that having maxtasksperchild=1 in the pool initialization for mosaic.py (the pool being used to read input catalogs in parallel) causes a bug where mosaic.py hangs indefinitely. Curiously, this happens only in with the LSST stack (pybind11 version), not with the HSC stack. It has been demonstrated that removing this constraint removes this hanging behavior.

      Attachments

        Issue Links

          Activity

            Before merging, please file another ticket to investigate what's going on here.

            swinbank John Swinbank added a comment - Before merging, please file another ticket to investigate what's going on here.
            jbosch Jim Bosch added a comment -

            I still have no idea what this does, but I'm quite willing to sign off on this on the basis that it's effectively a reversion to old behavior that we will let us move forward, and we'll investigate why it caused problems later.

            jbosch Jim Bosch added a comment - I still have no idea what this does, but I'm quite willing to sign off on this on the basis that it's effectively a reversion to old behavior that we will let us move forward, and we'll investigate why it caused problems later.

            OK, just merged.

            tmorton Tim Morton [X] (Inactive) added a comment - OK, just merged.

            People

              tmorton Tim Morton [X] (Inactive)
              tmorton Tim Morton [X] (Inactive)
              Jim Bosch
              Jim Bosch, John Swinbank, Tim Morton [X] (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Jenkins

                  No builds found.