Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-7717

Full-stack port to pybind11

    Details

    • Type: Epic
    • Status: Done
    • Priority: Major
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Templates:
    • Epic Name:
      s17-drp-pybind11
    • Story Points:
      100
    • WBS:
      02C.04.01
    • Team:
      Data Release Production
    • Cycle:
      Spring 2017

      Description

      Complete the work started in F16 to convert the Science Pipelines stack (lsst_distrib, plus associated meas_extensions) to expose C++ based functionality to Python using pybind11. Remove all Swig from the stack.

        Attachments

          Container Issues

            Issue Links

            Stories in Epic (Custom Issue Matrix)

            Key Summary Story Points Assignee Status
             
            DM-9701

            Cleanup pybind11 afw dependencies

            1 Pim Schellart [X] (Inactive) Done
             
            DM-9671

            Rename custom pybind11 namespace to python

            0.5 Pim Schellart [X] (Inactive) Done
             
            DM-9585

            Rebase pybind11 onto latest master

            2 Pim Schellart [X] (Inactive) Done
             
            DM-9447

            Process HSC RC data using pybind11 prototype

            5 Lauren MacArthur Done
             
            DM-9277

            Wrap obs_decam with pybind11 instead of swig

            0.5 Russell Owen Done
             
            DM-9278

            Wrap ctrl_platform_lsstvc with pybind11 instead of swig

            0.1 Pim Schellart [X] (Inactive) Done
             
            DM-9279

            Wrap cat with pybind11 instead of swig

            0.1 Russell Owen Done
             
            DM-9182

            Cleanup pybind11 code in afw

            3 Jim Bosch Done
             
            DM-9089

            Move pybind11 how-to technote to dev guide

            5 Pim Schellart [X] (Inactive) Done
             
            DM-9018

            Investigate downcasting of Table and Record types in pybind11

            2 Jim Bosch Done
             
            DM-8868

            Wrap ctrl_pool with pybind11

            0.1 Pim Schellart [X] (Inactive) Done
             
            DM-8869

            Wrap ctrl_platform_gordon with pybind11

            0.1 Pim Schellart [X] (Inactive) Done
             
            DM-8870

            Wrap ctrl_platform_lsst with pybind11

            0.1 Pim Schellart [X] (Inactive) Done
             
            DM-8871

            Wrap ctrl_execute with pybind11

            0.1 Pim Schellart [X] (Inactive) Done
             
            DM-8867

            Wrap lsst_apps with pybind11

            0 Pim Schellart [X] (Inactive) Done
             
            DM-8873

            Wrap ctrl_orca with pybind11

            0.1 Pim Schellart [X] (Inactive) Done
             
            DM-8866

            Wrap datarel with pybind11

            0.5 Pim Schellart [X] (Inactive) Done
             
            DM-8728

            SCons pybind11 builds re-link unnecessarily

            6 Jim Bosch Done
             
            DM-9711

            Clean up meas_base pybind11 wrappers

            2 Russell Owen Done
             
            DM-9392

            Wrap meas_extensions_convolved with pybind11 instead of swig

            0.5 Pim Schellart [X] (Inactive) Done
             
            DM-9258

            Modify pybind11 sconsUtils to only prepend underscore if not already present

            0.5 Russell Owen Done
             
            DM-8999

            Rebase pybind11 branch onto latest master

            2 Pim Schellart [X] (Inactive) Done
             
            DM-8888

            Upgrade pybind11 to version 2.x

            2 Pim Schellart [X] (Inactive) Done
             
            DM-8751

            Fix skipped testPickle in testSourceTable.py

            2 Russell Owen Done
             
            DM-8696

            Wrap testTicketDM-433 with pybind11

            1 Pim Schellart [X] (Inactive) Done
             
            DM-8631

            Robustify pybind11 holder type inheritance

            4 Pim Schellart [X] (Inactive) Done
             
            DM-9276

            Wrap obs_cfht with pybind11 instead of swig

            0.5 Russell Owen Done
             
            DM-9251

            Rebase pybind11 branch onto latest master

            2 Pim Schellart [X] (Inactive) Done
             
            DM-9096

            Wrap geom with pybind11

            0 Jim Bosch Done
             
            DM-8874

            Wrap display_ds9 with pybind11

            3 Russell Owen Done
             
            DM-8877

            Wrap skymap with pybind11

            2 Russell Owen Done
             
            DM-8876

            Wrap shapelet with pybind11

            5 Pim Schellart [X] (Inactive) Done
             
            DM-8652

            Wrap afw ds9 test with pybind11

            1 Pim Schellart [X] (Inactive) Done
             
            DM-8612

            build_templates.py creates incorrect test list

            1 Fred Moolekamp Done
             
            DM-8577

            Add pybind11 rules to DM dev-guide

            1 Pim Schellart [X] (Inactive) Done
             
            DM-8500

            Rebase pybind11 branch on master and move to new top level ticket

            1 Pim Schellart [X] (Inactive) Done
             
            DM-9583

            Update pex_exceptions to use pybind11::reinterpret_borrow / steal instead of object

            0.5 Pim Schellart [X] (Inactive) Done
             
            DM-9429

            Update lsst_dm_stack_demo for pybind11

            0.5 Russell Owen Done
             
            DM-9188

            Cleanup pybind11 code in core meas and ip packages

            4 Pim Schellart [X] (Inactive) Done
             
            DM-9157

            Write release notes for pybind11 port

            3 Pim Schellart [X] (Inactive) Done
             
            DM-9156

            Wrap ci_hsc with pybind11

            4 Pim Schellart [X] (Inactive) Done
             
            DM-9099

            Begin cleanup of pybind11 branch

            0 Jim Bosch Done
             
            DM-9100

            Merge pybind11 branches to master

            0.5 Pim Schellart [X] (Inactive) Done
             
            DM-9063

            Audit pybind11 port for outstanding technical debt

            3 Jim Bosch Done
             
            DM-9003

            Wrap clone for all table classes

            0.5 Pim Schellart [X] (Inactive) Done
             
            DM-8805

            Metaclass for wrapped-template ABCs and class extension decorators

            4 Jim Bosch Done
             
            DM-8716

            Use visitor pattern to clean up afw::table pybind11 wrappers

            6 Jim Bosch Done
             
            DM-8715

            Fix or remove pickling support for Match lists with pybind11

            2 Pim Schellart [X] (Inactive) Done
             
            DM-8619

            Enable testWarper.py with pybind11

            3 Russell Owen Done
             
            DM-9731

            Final pybind11 rebase on master

            0.1 Pim Schellart [X] (Inactive) Done
             
            DM-9528

            Cleanup pybind11 code in meas_deblender

            1 Fred Moolekamp Done
             
            DM-9428

            Update exceptions tutorial-level documentation for pybind11

            1 Pim Schellart [X] (Inactive) Done
             
            DM-9112

            Determine strategy for dealing with butler proxies in pybind11

            6 Pim Schellart [X] (Inactive) Done
             
            DM-9057

            Check int vs float interoperability in pybind11 afw.geom

            1 Jim Bosch Done
             
            DM-8818

            build_templates incorrectly adds a blank namespace

            1 Fred Moolekamp Done
             
            DM-8674

            Wrap testSourceTable with pybind11

            6 Russell Owen Done
             
            DM-8675

            Rebase pybind11 branch on master and strip GPU code

            1 Pim Schellart [X] (Inactive) Done
             
            DM-8597

            The pybind11 wrapper for CoaddInputs segfaults

            4 Pim Schellart [X] (Inactive) Done
             
            DM-8415

            Finish wrapping of pickling with pybind11 in afw

            4 Pim Schellart [X] (Inactive) Done
             
            DM-8417

            Wrap tests that depend on both image and table with pybind11

            8 Russell Owen Done
             
            DM-8453

            Wrap meas_algorithms with pybind11

            13.2 Pim Schellart [X] (Inactive) Done
             
            DM-8458

            Wrap meas_astrom with pybind11

            6 Russell Owen Done
             
            DM-8460

            Wrap ip_diffim with pybind11

            5 Russell Owen Done
             
            DM-8456

            Wrap meas_extensions_photometryKron with pybind11

            2 Russell Owen Done
             
            DM-8455

            Wrap meas_extensions_psfex with pybind11

            1.4 Pim Schellart [X] (Inactive) Done
             
            DM-8459

            Wrap ip_isr with pybind11

            2 Russell Owen Done
             
            DM-8457

            Wrap meas_deblender with pybind11

            0.4 Fred Moolekamp Done
             
            DM-8465

            Wrap meas_modelfit with pybind11

            5 Jim Bosch Done
             
            DM-8466

            Wrap obs_subaru with pybind11

            0.5 Pim Schellart [X] (Inactive) Done
             
            DM-8463

            Wrap obs_sdss with pybind11

            0.5 Russell Owen Done
             
            DM-8096

            Make "immediate=True" the default for butler.get()

            0.5 Russell Owen Done
             
            DM-7974

            Improve upstream pybind11 enum support

            2 Pim Schellart [X] (Inactive) Done
             
            DM-7797

            Wrap afw::image with pybind11

            12.9 Pim Schellart [X] (Inactive) Done
             
            DM-7799

            Wrap afw::display with pybind11

            9 Pim Schellart [X] (Inactive) Done
             
            DM-7056

            Wrap afw::table with pybind11

            32 Fred Moolekamp Done
             
            DM-7057

            Complete afw port to pybind11

            10 Pim Schellart [X] (Inactive) Done
             
            DM-6297

            Wrap afw::detection with pybind11

            5 Pim Schellart [X] (Inactive) Done
             
            DM-9280

            Wrap ctrl_events with pybind11 instead of swig

            6 Russell Owen Won't Fix
             
            DM-9121

            Investigate slow linking of pybind11 modules

            2 Jim Bosch Won't Fix
             
            DM-8875

            Wrap ctrl_provenance with pybind11

            0.1 Pim Schellart [X] (Inactive) Won't Fix
             
            DM-9696

            Fix lsst_sims on pybind11

            4 Unassigned Won't Fix

              Activity

                People

                • Assignee:
                  swinbank John Swinbank
                  Reporter:
                  swinbank John Swinbank
                  Watchers:
                  John Swinbank, Krzysztof Findeisen, Pim Schellart [X] (Inactive)
                • Votes:
                  0 Vote for this issue
                  Watchers:
                  3 Start watching this issue

                  Dates

                  • Created:
                    Updated:
                    Resolved:

                    Summary Panel