Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-21746

Add pyarrow to scipipe_conda_env

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Implementation of RFC-635

        Attachments

          Issue Links

            Activity

            Show
            swinbank John Swinbank added a comment - - edited PR: https://github.com/lsst/scipipe_conda_env/pull/7 Jenkins: https://ci.lsst.codes/blue/organizations/jenkins/stack-os-matrix/detail/stack-os-matrix/30648/pipeline
            Show
            swinbank John Swinbank added a comment - Jenkins is happy. Yusra AlSayyad , are you? PR is here: https://github.com/lsst/scipipe_conda_env/pull/7 After this is merged, I will add the SHA of the merge commit to https://github.com/lsst-dm/jenkins-dm-jobs/blob/master/etc/scipipe/build_matrix.yaml#L8 https://github.com/lsst/lsst/blob/master/scripts/newinstall.sh#L36 https://github.com/lsst/lsstsw/blob/master/bin/deploy#L23 without further review (unless you ask me not to).
            Hide
            yusra Yusra AlSayyad added a comment -

            Very happy! A thousand thanks!!

            And I really appreciate your writing up the instructions on how to add a single package to scipipe_conda_env with minimal impact. They would have saved past me a lot of trouble and will future devs. Note I was also following https://sqr-016.lsst.io/#adding-a-new-conda-package which Joshua Hoblitt pointed me too. With what I know now, they also seem incomplete as instructions for a pipelines dev.

            Things I didn't know a month ago:

            • The SPLENV_REFs can point to any SHA in scipipe_conda_env (including one on a ticket branch)
            • That you have resolve the conda env on a linux or osx system.
            • That the FIRST place you should change SPLENV_REF is in lsstsw, and then try to deploy and rebuild.
            • How to test: (1) start with rebuilding lsstsw with the new SPLENV_REF. (2) Then try newinstall.sh with the new ref + eups distrib install.
            Show
            yusra Yusra AlSayyad added a comment - Very happy! A thousand thanks!! And I really appreciate your writing up the instructions on how to add a single package to scipipe_conda_env with minimal impact. They would have saved past me a lot of trouble and will future devs. Note I was also following https://sqr-016.lsst.io/#adding-a-new-conda-package which Joshua Hoblitt pointed me too. With what I know now, they also seem incomplete as instructions for a pipelines dev. Things I didn't know a month ago: The SPLENV_REFs can point to any SHA in scipipe_conda_env (including one on a ticket branch) That you have resolve the conda env on a linux or osx system. That the FIRST place you should change SPLENV_REF is in lsstsw , and then try to deploy and rebuild. How to test: (1) start with rebuilding lsstsw with the new SPLENV_REF. (2) Then try newinstall.sh with the new ref + eups distrib install.
            Hide
            swinbank John Swinbank added a comment -

            Merged to scipipe_conda_env. SHA is f032070. Will now add that to the three locations referenced above.

            Show
            swinbank John Swinbank added a comment - Merged to scipipe_conda_env. SHA is f032070 . Will now add that to the three locations referenced above.
            Hide
            swinbank John Swinbank added a comment -

            All merged.

            Show
            swinbank John Swinbank added a comment - All merged.

              People

              • Assignee:
                swinbank John Swinbank
                Reporter:
                yusra Yusra AlSayyad
                Reviewers:
                Yusra AlSayyad
                Watchers:
                John Swinbank, Tim Jenness, Yusra AlSayyad
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel