pybind11 does not support converting unique_ptr to shared_ptr; see https://github.com/pybind/pybind11/issues/1138.  That means you currently have to pick one smart pointer for each class and always use it, or use lambdas to wrap unique_ptr returns for classes with a shared_ptr holder type.