Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-15408

measureCrosstalk.py is not thread safe

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Invalid
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: ip_isr
    • Labels:
      None

      Description

      When run on a Phosim repo with e.g. -j 10 

      measureCrosstalk.py /scratch/rlupton/phosim --rerun rhl/xtalk --id visit=185783 --dump ratios.pickle --outputFile foo.yaml -j 10 

      (n.b. that last argument is almost certainly irrelevant, but isn't on master) I'm getting errors such as:

      CameraMapper INFO: Loading exposure registry from /scratch/rlupton/phosim/registry.sqlite3
      CameraMapper INFO: Loading calib registry from /scratch/rlupton/phosim/CALIB/calibRegistry.sqlite3
      Exception ignored in: <bound method SqlRegistry.__del__ of <lsst.daf.persistence.registries.SqliteRegistry object at 0x7fa99bc80e48>>
      Traceback (most recent call last):
        File "/ssd/lsstsw/stack/stack/current/Linux64/daf_persistence/16.0-3-g3806c63+1/python/lsst/daf/persistence/registries.py", line 323, in __del__
          self.conn.close()
      sqlite3.ProgrammingError: SQLite objects created in a thread can only be used in that same thread.The object was created in thread id 140368280430336 and this is thread id 140368230090496
       

      This may not be worth fixing with PipelineTask (née SuperTask) on the horizon.  Or is SuperTask masculine?

        Attachments

          Issue Links

            Activity

            Hide
            czw Christopher Waters added a comment -

            The rewrite of measureCrosstalk.py for gen3 removes this issue.

            Show
            czw Christopher Waters added a comment - The rewrite of measureCrosstalk.py for gen3 removes this issue.

              People

              Assignee:
              Unassigned Unassigned
              Reporter:
              rhl Robert Lupton
              Watchers:
              Christopher Waters, Robert Lupton
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins Builds

                  No builds found.