Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-15031

ci_hsc due to shebang length

    Details

      Description

      Per Jim Bosch, a build of ci_hsc failed yesterday almost certainly because the python shebang is now > 127 chars due to use of conda envs in DM-14011

      https://ci.lsst.codes/blue/organizations/jenkins/science-pipelines%2Fci_hsc/detail/ci_hsc/47/pipeline/

      :::  [2018-07-06T02:46:57.528006Z] sh: /home/jenkins-slave/workspace/science-pipelines/ci_hsc/centos-7.devtoolset-6.py3/lsstsw/stack/Linux64/pytest/3.2.0.lsst4+1/bin/pytest: /home/jenkins-slave/workspace/science-pipelines/ci_hsc/centos-7.devtoolset-6.p: bad interpreter: No such file or directory
      

        Attachments

          Issue Links

            Activity

            Hide
            jhoblitt Joshua Hoblitt added a comment -

            The [low hanging] jenkins folders science-pipelines and sqre/infrastructure have been abbreviated to sci-pipe (perhaps no dash would be better?) and sqre/infra. An existing/unmerged commit changing the default conda env name from lsst-dm-scipipe to lsst-scipipe has been cherry-picked from a lsstsw / DM-14011 branch and merged. This should reduce the length of the ci_hsc shebang by 12 chars and the net change from prior to July 4th to +4 chars.

            Kian-Tat Lim suggested on slack renaming the jenkins default workspace root. This is a good idea but its a global default controlled by jvm flags, I believe on each agent, so it would either require restarting the world or manually specifying the workspace path per job. The later feels ugly and I'm slightly concerned about unexpected fallout from the former without testing it for several days in a test env.

            Show
            jhoblitt Joshua Hoblitt added a comment - The [low hanging] jenkins folders science-pipelines and sqre/infrastructure have been abbreviated to sci-pipe (perhaps no dash would be better?) and sqre/infra . An existing/unmerged commit changing the default conda env name from lsst-dm-scipipe to lsst-scipipe has been cherry-picked from a lsstsw / DM-14011 branch and merged. This should reduce the length of the ci_hsc shebang by 12 chars and the net change from prior to July 4th to +4 chars. Kian-Tat Lim suggested on slack renaming the jenkins default workspace root. This is a good idea but its a global default controlled by jvm flags, I believe on each agent, so it would either require restarting the world or manually specifying the workspace path per job. The later feels ugly and I'm slightly concerned about unexpected fallout from the former without testing it for several days in a test env.
            Show
            jhoblitt Joshua Hoblitt added a comment - Rebuilds of most recent ci_hsc and lsst_distrib failures: https://ci.lsst.codes/blue/organizations/jenkins/sci-pipe%2Fci_hsc/detail/ci_hsc/48/pipeline https://ci.lsst.codes/blue/organizations/jenkins/sci-pipe%2Flsst_distrib/detail/lsst_distrib/305/pipeline
            Hide
            jhoblitt Joshua Hoblitt added a comment -

            I've decided that sci-pipe should be renamed to scipipe, if for no other reason that to remove the url encoding of the - in links.  However, this has to wait until after the current builds finish.

            Show
            jhoblitt Joshua Hoblitt added a comment - I've decided that sci-pipe should be renamed to scipipe, if for no other reason that to remove the url encoding of the - in links .  However, this has to wait until after the current builds finish.
            Hide
            jhoblitt Joshua Hoblitt added a comment -

            The sci-pipe -> scipipe rename has been merged.

            I've done some testing and I've decided I want to go ahead and change the "fsroot" and default "workspace" name as this breaks shebangs/etc. internal to conda, this might as well be done during a holiday week.

            Show
            jhoblitt Joshua Hoblitt added a comment - The sci-pipe -> scipipe rename has been merged. I've done some testing and I've decided I want to go ahead and change the "fsroot" and default "workspace" name as this breaks shebangs/etc. internal to conda, this might as well be done during a holiday week.

              People

              • Assignee:
                jhoblitt Joshua Hoblitt
                Reporter:
                jhoblitt Joshua Hoblitt
                Watchers:
                Gabriele Comoretto, Jim Bosch, Joshua Hoblitt, Kian-Tat Lim, Simon Krughoff, Tim Jenness
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel