Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-13632

Add additional conda packages to the lsst-dev shared stack

    XMLWordPrintable

    Details

    • Story Points:
      1
    • Epic Link:
    • Sprint:
      AP S18-3, AP S18-4, AP S18-5
    • Team:
      Alert Production

      Description

      On Slack, Tim Morton [X] writes:

      conda install dask distributed datashader
      		 
      conda install bokeh=0.12.14
      		 
      conda install -c conda-forge holoviews
      		 
      conda install -c ioam parambokeh

      Oh, and fastparquet

      Hsin-Fang Chiang says:

      Is it possible to install fastparquent in the shared stack at /software? It's used in pipe_analysis.

        Attachments

          Issue Links

          relates to

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-13673 Add pipe_analysis dependencies to shared-stack bootstrap

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-13645 Figure out how to start a dask cluster at lsst-dev using shared stack

          • Won't Fix

            Activity

            Ascending order - Click to sort in descending order
            36 older comments
            Hide
            Permalink
            jbosch Jim Bosch added a comment -

            Just saw some of the traffic for this issue for the first time, and I'm sorry it seems to have been such an ordeal...but now that it seems to be (mostly) done, I think this ticket already includes everything we need to implement RFC-420 aside from tqdm (which I believe is available from default conda channels and doesn't have any tricky dependencies).  Any chance we could toss that in as well?

            Show
            jbosch Jim Bosch added a comment - Just saw some of the traffic for this issue for the first time, and I'm sorry it seems to have been such an ordeal...but now that it seems to be (mostly) done, I think this ticket already includes everything we need to implement RFC-420 aside from tqdm (which I believe is available from default conda channels and doesn't have any tricky dependencies).  Any chance we could toss that in as well?
            Hide
            Permalink
            swinbank John Swinbank added a comment -

            Jim Bosch — yes, but at least for this ticket all I've done is wedge packages into the existing stack. Implementing RFC-420 via DM-12919 involves documentation and updating the shared stack bootstrap stack, which I have punted here for the sake of getting Tim up and running "quickly".

            Anyway, I've just added tqdm to /ssd/lsstsw/stack/loadLSST.bash and will roll it out to other stacks before closing this ticket.

            Show
            swinbank John Swinbank added a comment - Jim Bosch — yes, but at least for this ticket all I've done is wedge packages into the existing stack. Implementing RFC-420 via DM-12919 involves documentation and updating the shared stack bootstrap stack, which I have punted here for the sake of getting Tim up and running "quickly". Anyway, I've just added tqdm to /ssd/lsstsw/stack/loadLSST.bash and will roll it out to other stacks before closing this ticket.
            Hide
            Permalink
            swinbank John Swinbank added a comment -

            Ok, digging out from this one. My master list of things to install is:

            $ conda install --no-update-deps -c anaconda dask=0.17.1
            		 
            $ conda install --no-update-deps -c bokeh datashader=0.6.5
            		 
            $ conda install --no-update-deps -c bokeh bokeh=0.12.14
            		 
            $ conda install --no-update-deps -c ioam holoviews=1.9.4
            		 
            $ conda install --no-update-deps -c ioam parambokeh=0.2.1
            		 
            $ conda install --no-update-deps -c conda-forge fastparquet=0.1.4
            		 
            $ conda install --no-update-deps -c anaconda pytables=3.4.2
            		 
            $ conda install --no-update-deps -c conda-forge ginga
            		 
            $ conda install -c conda-forge ipyevents=0.2.0=py36_0
            		 
            $ conda install --no-update-deps tqdm

            Note that ipyevents is Python 3 only; don't bother trying on one of the Py2 stacks.

            Am now rolling the above out to all of the shared stacks on lsst-dev.

            Tim Morton [X] seems to have figured out the trick for registering Jupyter extensions. Tim, maybe you can write that up somewhere appropriate? (e.g. in the qa_explorer docs).

            Anything left to be done here? If not, Tim Morton [X] can you please mark this as reviewed? (Phew!)

            Show
            swinbank John Swinbank added a comment - Ok, digging out from this one. My master list of things to install is: $ conda install --no-update-deps -c anaconda dask=0.17.1 $ conda install --no-update-deps -c bokeh datashader=0.6.5 $ conda install --no-update-deps -c bokeh bokeh=0.12.14 $ conda install --no-update-deps -c ioam holoviews=1.9.4 $ conda install --no-update-deps -c ioam parambokeh=0.2.1 $ conda install --no-update-deps -c conda-forge fastparquet=0.1.4 $ conda install --no-update-deps -c anaconda pytables=3.4.2 $ conda install --no-update-deps -c conda-forge ginga $ conda install -c conda-forge ipyevents=0.2.0=py36_0 $ conda install --no-update-deps tqdm Note that ipyevents is Python 3 only ; don't bother trying on one of the Py2 stacks. Am now rolling the above out to all of the shared stacks on lsst-dev . Tim Morton [X] seems to have figured out the trick for registering Jupyter extensions. Tim, maybe you can write that up somewhere appropriate? (e.g. in the qa_explorer docs). Anything left to be done here? If not, Tim Morton [X] can you please mark this as reviewed? (Phew!)
            Hide
            Permalink
            tmorton Tim Morton [X] (Inactive) added a comment -

            I think all is good here. Jim Bosch was able to run a qa_explorer-based notebook last week using the shared stack and following the qa_explorer readme, so this should be all ok.

            Show
            tmorton Tim Morton [X] (Inactive) added a comment - I think all is good here. Jim Bosch was able to run a qa_explorer -based notebook last week using the shared stack and following the qa_explorer readme, so this should be all ok.
            Hide
            Permalink
            swinbank John Swinbank added a comment -

            Thanks Tim!

            Show
            swinbank John Swinbank added a comment - Thanks Tim!

              People

              Assignee:
              swinbank John Swinbank
              Reporter:
              swinbank John Swinbank
              Reviewers:
              Tim Morton [X] (Inactive)
              Watchers:
              Hsin-Fang Chiang, Jim Bosch, John Swinbank, Tim Morton [X] (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.