Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-10834

CmdLineTask -j multiprocessing hangs with long data ID lists

    Details

    • Type: Bug
    • Status: Done
    • Priority: Undefined
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: pipe_base
    • Labels:
      None
    • Templates:
    • Story Points:
      6
    • Team:
      Data Release Production

      Description

      processCcd.py seems to reliably hang when given long data ID lists (possibly only on Python 2, but on at least Ubuntu Linux and OSX). To reproduce:

      • Run scons on ci_hsc to create the raw data repository (can kill it after it starts running ProcessCcdTask).
      • Run

        processCcd.py DATA -j2 --rerun mpbug --id visit=903334..903338:2 --id visit=903342..903346:2   --id visit=903986..903990:2 --id visit=904010^904014
        

        Attachments

          Container Issues

            Issue Links

              Activity

                People

                • Assignee:
                  jbosch Jim Bosch
                  Reporter:
                  jbosch Jim Bosch
                  Reviewers:
                  Pim Schellart [X] (Inactive)
                  Watchers:
                  Jim Bosch, John Swinbank, Jonathan Sick, Merlin Fisher-Levine, Paul Price, Pim Schellart [X] (Inactive), Robert Lupton
                • Votes:
                  0 Vote for this issue
                  Watchers:
                  7 Start watching this issue

                  Dates

                  • Created:
                    Updated:
                    Resolved:

                    Summary Panel