Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-17739

Recent update to TaskLoader breaks pickle

    Details

    • Story Points:
      0.5
    • Sprint:
      BG3_S19_02
    • Team:
      Data Access and Database

      Description

      Michelle Gower reported issues with pickling QuantumGraph which produces diagnostics like this:

      Failed to build graph: Can't pickle <class 'lsst.ip.isr.isrTask.IsrTaskConfig'>: it's not the same object as lsst.ip.isr.isrTask.IsrTaskConfig
      Traceback (most recent call last):
        File "/home/mgower/gen3work/full_hsc/git/ctrl_mpexec/bin/pipetask", line 26, in <module>
          sys.exit(CmdLineFwk().parseAndRun())
        File "/home/mgower/gen3work/full_hsc/git/ctrl_mpexec/python/lsst/ctrl/mpexec/cmdLineFwk.py", line 127, in parseAndRun
          qgraph = self.makeGraph(pipeline, taskFactory, args)
        File "/home/mgower/gen3work/full_hsc/git/ctrl_mpexec/python/lsst/ctrl/mpexec/cmdLineFwk.py", line 359, in makeGraph
          pickle.dump(qgraph, pickleFile)
      _pickle.PicklingError: Can't pickle <class 'lsst.ip.isr.isrTask.IsrTaskConfig'>: it's not the same object as lsst.ip.isr.isrTask.IsrTaskConfig 

      This seems to be related to last change in module import in TaskLoader.

        Attachments

          Issue Links

            Activity

            Hide
            salnikov Andy Salnikov added a comment -

            Trivial fix (though issue is not trivial). Self-reviewed and merged.

            Show
            salnikov Andy Salnikov added a comment - Trivial fix (though issue is not trivial). Self-reviewed and merged.

              People

              • Assignee:
                salnikov Andy Salnikov
                Reporter:
                salnikov Andy Salnikov
                Watchers:
                Andy Salnikov
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel