Uploaded image for project: 'Request For Comments'
  1. Request For Comments
  2. RFC-50

Simplify distribution of common python modules

    XMLWordPrintable

    Details

    • Type: RFC
    • Status: Withdrawn
    • Resolution: Done
    • Component/s: DM
    • Labels:
    • Location:
      Jira comments of this RFC

      Description

      It'd be useful to have a lightweight way of packaging up dependencies that happen to be common python packages. Examples include requests, flask, kazoo, etc. Packaging it through eups is not very heavy, but it feels like a unnecessary burden.

      Proposal: package up all such dependencies in a simple text file and use "pip install blah" to install them each in turn.

      This got triggered through DM-2727.

        Attachments

          Issue Links

            Activity

            Hide
            krughoff Simon Krughoff added a comment -

            There was a push a while back to go "all in" with conda. That was met with a fair amount of opposition. We could revisit that and maybe the opposition has softened.

            Show
            krughoff Simon Krughoff added a comment - There was a push a while back to go "all in" with conda. That was met with a fair amount of opposition. We could revisit that and maybe the opposition has softened.
            Hide
            jsick Jonathan Sick added a comment -

            I think we'd want to establish that conda binaries can be built reliably, first. cc: J Matt Peterson [X].

            Show
            jsick Jonathan Sick added a comment - I think we'd want to establish that conda binaries can be built reliably, first. cc: J Matt Peterson [X] .
            Hide
            tjenness Tim Jenness added a comment -

            I think we can "solve" this by saying that the list of packages and versions that lsstsw specifies in the conda version pinning file is the list of packages needed as pre-requisites. Then people who aren't on conda can still get at something that can be transformed to a requirements.txt file, and conda users can work out what packages we need (even if that user does not pin). I don't think binary distribution matters at that point.

            There is still the other point of when to package in EUPS and when to have a stub EUPS package. That has recently depended on the complexity of the specific package: packages wth minimal dependencies get an EUPS package and complex dependencies have a stub.

            I believe I see that EUPS recently had the ability to check for a python package existing from a table file without that python package being an EUPS product.

            Show
            tjenness Tim Jenness added a comment - I think we can "solve" this by saying that the list of packages and versions that lsstsw specifies in the conda version pinning file is the list of packages needed as pre-requisites. Then people who aren't on conda can still get at something that can be transformed to a requirements.txt file, and conda users can work out what packages we need (even if that user does not pin). I don't think binary distribution matters at that point. There is still the other point of when to package in EUPS and when to have a stub EUPS package. That has recently depended on the complexity of the specific package: packages wth minimal dependencies get an EUPS package and complex dependencies have a stub. I believe I see that EUPS recently had the ability to check for a python package existing from a table file without that python package being an EUPS product.
            Hide
            tjenness Tim Jenness added a comment -

            Escalating as we are not making progress.

            Show
            tjenness Tim Jenness added a comment - Escalating as we are not making progress.
            Hide
            tjenness Tim Jenness added a comment -

            This RFC is going nowhere and we have decided to withdraw until we have a concrete proposal.

            Show
            tjenness Tim Jenness added a comment - This RFC is going nowhere and we have decided to withdraw until we have a concrete proposal.

              People

              Assignee:
              ktl Kian-Tat Lim
              Reporter:
              jbecla Jacek Becla
              Watchers:
              Andy Salnikov, Fritz Mueller, Frossie Economou, Jacek Becla, Jim Bosch, John Parejko, John Swinbank, Jonathan Sick, Joshua Hoblitt, Kian-Tat Lim, Lynne Jones, Mario Juric, Pim Schellart [X] (Inactive), Simon Krughoff, Tim Jenness, Xiuqin Wu [X] (Inactive), Zeljko Ivezic
              Votes:
              0 Vote for this issue
              Watchers:
              17 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:
                Planned End: