Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-15847

pytest (and scons) are broken on the lsst-dev01 shared stack

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Won't Fix
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Team:
      Alert Production

      Description

      The most recent weekly (w_2018_38) on the shared stack on lsst-dev01 cannot run pytest or scons. This has been traced to an update to the conda environment, and (I believe) the fact that the inaptly named py python package needs an update to be consistent with the version of pytest that we use (3.6.1).

        Attachments

          Issue Links

            Activity

            Hide
            tjenness Tim Jenness added a comment -

            This was caused by a combination of changes. When I added pytest as an EUPS package I couldn't believe there was a package called py that I also needed to install so it didn't get an eups package of its own. A while back the conda reference packages were updated in lsstsw/newinstall/Jenkins but not on the shared stack. This wasn't a problem until DM-11693 updated pytest to v3.6.x (matching the new Jekins version).

            Adding a py TaP package probably won't be enough because of the setuptools bug that causes it to ignore PYTHONPATH in site.py if there is a version of the package in the system python library. One of the reasons we couldn't update pytest until conda was updated was because the conda version always tended to take priority.

            Show
            tjenness Tim Jenness added a comment - This was caused by a combination of changes. When I added pytest as an EUPS package I couldn't believe there was a package called py that I also needed to install so it didn't get an eups package of its own. A while back the conda reference packages were updated in lsstsw/newinstall/Jenkins but not on the shared stack. This wasn't a problem until DM-11693 updated pytest to v3.6.x (matching the new Jekins version). Adding a py TaP package probably won't be enough because of the setuptools bug that causes it to ignore PYTHONPATH in site.py if there is a version of the package in the system python library. One of the reasons we couldn't update pytest until conda was updated was because the conda version always tended to take priority.
            Hide
            swinbank John Swinbank added a comment -

            I believe this has been addressed by DM-16129, which provides a new stack containing the w_2018_41 weekly. Eli Rykoff, can you confirm that this fixes your problem?

            Show
            swinbank John Swinbank added a comment - I believe this has been addressed by DM-16129 , which provides a new stack containing the w_2018_41 weekly. Eli Rykoff , can you confirm that this fixes your problem?
            Hide
            erykoff Eli Rykoff added a comment -

            Hooray!  The new shared stack is able to run scons and pytest as expected.

            Show
            erykoff Eli Rykoff added a comment - Hooray!  The new shared stack is able to run scons and pytest as expected.
            Hide
            tjenness Tim Jenness added a comment -

            Brian Van Klaveren is working on the longer term fix in DM-15873 and DM-16163.

            Show
            tjenness Tim Jenness added a comment - Brian Van Klaveren is working on the longer term fix in DM-15873 and DM-16163 .
            Hide
            swinbank John Swinbank added a comment -

            Thanks Eli Rykoff!

            Show
            swinbank John Swinbank added a comment - Thanks Eli Rykoff !
            Hide
            erykoff Eli Rykoff added a comment -

            Honest question: why is this a "Won't Fix"?  It is fixed, right?  Or is the problem that it won't be fixed specifically on w_2018_38?

            Show
            erykoff Eli Rykoff added a comment - Honest question: why is this a "Won't Fix"?  It is  fixed, right?  Or is the problem that it won't be fixed specifically on w_2018_38 ?
            Hide
            swinbank John Swinbank added a comment -

            Well, the real point is that there's no work being done here. I took action (& claimed credit for it) on DM-16129; there's other work ongoing on DM-15873 & DM-16163; nobody is going to come along and do something more to address this ticket specifically.

            Show
            swinbank John Swinbank added a comment - Well, the real point is that there's no work being done here. I took action (& claimed credit for it) on DM-16129 ; there's other work ongoing on DM-15873 & DM-16163 ; nobody is going to come along and do something more to address this ticket specifically.

              People

              Assignee:
              swinbank John Swinbank
              Reporter:
              erykoff Eli Rykoff
              Watchers:
              Brian Van Klaveren, Eli Rykoff, John Swinbank, Joshua Hoblitt, Tim Jenness
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.