Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-10834

CmdLineTask -j multiprocessing hangs with long data ID lists

    Details

    • Type: Bug
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: pipe_base
    • Labels:
      None
    • Templates:
    • Story Points:
      6
    • Team:
      Data Release Production

      Description

      processCcd.py seems to reliably hang when given long data ID lists (possibly only on Python 2, but on at least Ubuntu Linux and OSX). To reproduce:

      • Run scons on ci_hsc to create the raw data repository (can kill it after it starts running ProcessCcdTask).
      • Run

        processCcd.py DATA -j2 --rerun mpbug --id visit=903334..903338:2 --id visit=903342..903346:2   --id visit=903986..903990:2 --id visit=904010^904014
        

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                jbosch Jim Bosch
                Reporter:
                jbosch Jim Bosch
                Reviewers:
                Pim Schellart [X] (Inactive)
                Watchers:
                Jim Bosch, John Swinbank, Jonathan Sick, Merlin Fisher-Levine, Paul Price, Pim Schellart [X] (Inactive), Robert Lupton
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel