Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-346

Can't install sconsUtils with eupspkg

    Details

    • Type: Bug
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: Qserv
    • Labels:
    • Team:
      Data Access and Database

      Description

      DM-58 require packaging of db library, which relies on sconsUtils.

      That's why i try to install sconsUtils with next command, but it fails :

      fjammes@clrlsst-dbmaster-vm:~/src/qserv (tickets/DM-58) $ eups distrib install sconsUtils 6.2.0.0_19_g755151c0a5+9ff2ee7baa --repository="http://lsst-web.ncsa.illinois.edu/~mjuric/pkgs"
        [  1/4  ]  doxygen 1.8.2                                              done. 
        [  2/4  ]  python system (already installed)                          done. 
        [  3/4  ]  scons system (already installed)                           done. 
        [  4/4  ]  sconsUtils 6.2.0.0_19_g755151c0a5+9ff2ee7baa ...
       
      ***** error: from /opt/qserv/stack/EupsBuildDir/Linux64/sconsUtils-6.2.0.0_19_g755151c0a5+9ff2ee7baa/build.log:
      python                system     	current setup
      scons                 system     	current setup
      + ./ups/eupspkg VERBOSE=0 FLAVOR=Linux64 fetch
      + ./ups/eupspkg VERBOSE=0 FLAVOR=Linux64 prep
      + setup --type=build -k -r .
      ++ /opt/qserv/eups/bin/eups_setup --type=build -k -r .
      + eval export 'PATH=/opt/qserv/stack/EupsBuildDir/Linux64/sconsUtils-6.2.0.0_19_g755151c0a5+9ff2ee7baa/sconsUtils-6.2.0.0_19_g755151c0a5+9ff2ee7baa/bin:/opt/qserv/stack/Linux64/doxygen/1.8.2/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/fjammes/go/bin:/home/fjammes/bin:/opt/qserv/eups/bin;' export 'PYTHONPATH=/opt/qserv/stack/EupsBuildDir/Linux64/sconsUtils-6.2.0.0_19_g755151c0a5+9ff2ee7baa/sconsUtils-6.2.0.0_19_g755151c0a5+9ff2ee7baa/python:/opt/qserv/eups/python;' export 'SETUP_SCONSUTILS='\''sconsUtils' LOCAL:/opt/qserv/stack/EupsBuildDir/Linux64/sconsUtils-6.2.0.0_19_g755151c0a5+9ff2ee7baa/sconsUtils-6.2.0.0_19_g755151c0a5+9ff2ee7baa -f Linux64 -Z '(none)'\'';' export SCONSUTILS_DIR=/opt/qserv/stack/EupsBuildDir/Linux64/sconsUtils-6.2.0.0_19_g755151c0a5+9ff2ee7baa/sconsUtils-6.2.0.0_19_g755151c0a5+9ff2ee7baa
      ++ export PATH=/opt/qserv/stack/EupsBuildDir/Linux64/sconsUtils-6.2.0.0_19_g755151c0a5+9ff2ee7baa/sconsUtils-6.2.0.0_19_g755151c0a5+9ff2ee7baa/bin:/opt/qserv/stack/Linux64/doxygen/1.8.2/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/fjammes/go/bin:/home/fjammes/bin:/opt/qserv/eups/bin
      ++ PATH=/opt/qserv/stack/EupsBuildDir/Linux64/sconsUtils-6.2.0.0_19_g755151c0a5+9ff2ee7baa/sconsUtils-6.2.0.0_19_g755151c0a5+9ff2ee7baa/bin:/opt/qserv/stack/Linux64/doxygen/1.8.2/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/fjammes/go/bin:/home/fjammes/bin:/opt/qserv/eups/bin
      ++ export PYTHONPATH=/opt/qserv/stack/EupsBuildDir/Linux64/sconsUtils-6.2.0.0_19_g755151c0a5+9ff2ee7baa/sconsUtils-6.2.0.0_19_g755151c0a5+9ff2ee7baa/python:/opt/qserv/eups/python
      ++ PYTHONPATH=/opt/qserv/stack/EupsBuildDir/Linux64/sconsUtils-6.2.0.0_19_g755151c0a5+9ff2ee7baa/sconsUtils-6.2.0.0_19_g755151c0a5+9ff2ee7baa/python:/opt/qserv/eups/python
      ++ export 'SETUP_SCONSUTILS=sconsUtils LOCAL:/opt/qserv/stack/EupsBuildDir/Linux64/sconsUtils-6.2.0.0_19_g755151c0a5+9ff2ee7baa/sconsUtils-6.2.0.0_19_g755151c0a5+9ff2ee7baa -f Linux64 -Z (none)'
      ++ SETUP_SCONSUTILS='sconsUtils LOCAL:/opt/qserv/stack/EupsBuildDir/Linux64/sconsUtils-6.2.0.0_19_g755151c0a5+9ff2ee7baa/sconsUtils-6.2.0.0_19_g755151c0a5+9ff2ee7baa -f Linux64 -Z (none)'
      ++ export SCONSUTILS_DIR=/opt/qserv/stack/EupsBuildDir/Linux64/sconsUtils-6.2.0.0_19_g755151c0a5+9ff2ee7baa/sconsUtils-6.2.0.0_19_g755151c0a5+9ff2ee7baa
      ++ SCONSUTILS_DIR=/opt/qserv/stack/EupsBuildDir/Linux64/sconsUtils-6.2.0.0_19_g755151c0a5+9ff2ee7baa/sconsUtils-6.2.0.0_19_g755151c0a5+9ff2ee7baa
      + ./ups/eupspkg VERBOSE=0 FLAVOR=Linux64 config
      + ./ups/eupspkg VERBOSE=0 FLAVOR=Linux64 build
      scons: Reading SConscript files ...
      SCons 2.1 or greater required, but you have SCons 2.0.1
      + exit -4
      eups distrib: Failed to build sconsUtils-6.2.0.0_19_g755151c0a5+9ff2ee7baa.eupspkg: Command:
      	source /opt/qserv/eups/bin/setups.sh; export EUPS_PATH=/opt/qserv/stack; (/opt/qserv/stack/EupsBuildDir/Linux64/sconsUtils-6.2.0.0_19_g755151c0a5+9ff2ee7baa/build.sh) >> /opt/qserv/stack/EupsBuildDir/Linux64/sconsUtils-6.2.0.0_19_g755151c0a5+9ff2ee7baa/build.log 2>&1 4>/opt/qserv/stack/EupsBuildDir/Linux64/sconsUtils-6.2.0.0_19_g755151c0a5+9ff2ee7baa/build.msg 
      exited with code 252

      scons can't be installed, indeed it seems it eups package is outdated (please look at REPOSITORY variable in its pkginfo file below):

      fjammes@clrlsst-dbmaster-vm:~/src/qserv (tickets/DM-58) $ cat /opt/qserv/stack/EupsBuildDir/Linux64/scons-2.1.0_3_gc22e6b1da4+12ac34fb5a/scons-2.1.0_3_gc22e6b1da4+12ac34fb5a/ups/pkginfo 
      PRODUCT='scons'
      VERSION='2.1.0_3_gc22e6b1da4+12ac34fb5a'
      FLAVOR='generic'
      SOURCE='git'
      SHA1='c22e6b1da407adaf1eefaa8893ec7b0524ce21aa'
      REPOSITORY='git://git.lsstcorp.org/contrib/eupspkg/scons'
      REPOVERSION='c22e6b1da407adaf1eefaa8893ec7b0524ce21aa'
       

      Furthermore while trying to install sconsUtils 6.2.0.0_16_gc9d884655a+759c3944a1, scons succeed to install but an other error happen :

      fjammes@clrlsst-dbmaster-vm:~/src/qserv (tickets/DM-58) $ eups distrib install sconsUtils 6.2.0.0_16_gc9d884655a+759c3944a1 --repository="http://lsst-web.ncsa.illinois.edu/~mjuric/pkgs" 
        [  1/4  ]  doxygen 1.8.2 (already installed)                          done. 
        [  2/4  ]  python system (already installed)                          done. 
        [  3/4  ]  scons 2.1.0+2b5a2f1b52 (already installed)                 done. 
        [  4/4  ]  sconsUtils 6.2.0.0_16_gc9d884655a+759c3944a1 ...
       
      ***** error: from /opt/qserv/stack/EupsBuildDir/Linux64/sconsUtils-6.2.0.0_16_gc9d884655a+759c3944a1/build.log:
      ++ export 'SETUP_PYTHON=python system -f Linux64 -Z /opt/qserv/stack'
      ++ SETUP_PYTHON='python system -f Linux64 -Z /opt/qserv/stack'
      + setup --just --type=build scons 2.1.0+2b5a2f1b52
      ++ /opt/qserv/eups/bin/eups_setup --just --type=build scons 2.1.0+2b5a2f1b52
      + eval export 'PATH=/opt/qserv/stack/Linux64/scons/2.1.0+2b5a2f1b52/bin:/opt/qserv/stack/Linux64/doxygen/1.8.2/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/fjammes/go/bin:/home/fjammes/bin:/opt/qserv/eups/bin;' export 'SCONS_DIR=/opt/qserv/stack/Linux64/scons/2.1.0+2b5a2f1b52;' export 'SETUP_SCONS='\''scons' 2.1.0+2b5a2f1b52 -f Linux64 -Z '/opt/qserv/stack'\'';' export SCONS_DIR_EXTRA=/opt/qserv/stack/ups_db/Linux64/scons/2.1.0+2b5a2f1b52
      ++ export PATH=/opt/qserv/stack/Linux64/scons/2.1.0+2b5a2f1b52/bin:/opt/qserv/stack/Linux64/doxygen/1.8.2/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/fjammes/go/bin:/home/fjammes/bin:/opt/qserv/eups/bin
      ++ PATH=/opt/qserv/stack/Linux64/scons/2.1.0+2b5a2f1b52/bin:/opt/qserv/stack/Linux64/doxygen/1.8.2/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/fjammes/go/bin:/home/fjammes/bin:/opt/qserv/eups/bin
      ++ export SCONS_DIR=/opt/qserv/stack/Linux64/scons/2.1.0+2b5a2f1b52
      ++ SCONS_DIR=/opt/qserv/stack/Linux64/scons/2.1.0+2b5a2f1b52
      ++ export 'SETUP_SCONS=scons 2.1.0+2b5a2f1b52 -f Linux64 -Z /opt/qserv/stack'
      ++ SETUP_SCONS='scons 2.1.0+2b5a2f1b52 -f Linux64 -Z /opt/qserv/stack'
      ++ export SCONS_DIR_EXTRA=/opt/qserv/stack/ups_db/Linux64/scons/2.1.0+2b5a2f1b52
      ++ SCONS_DIR_EXTRA=/opt/qserv/stack/ups_db/Linux64/scons/2.1.0+2b5a2f1b52
      + eups list -s
      doxygen               1.8.2      	b63 b61 b41 b48 b137 b301 b303 b302 b304 current b58 b59 b38 b39 b34 b53 b36 b37 b30 b57 b54 b33 b142 setup
      python                system     	current setup
      scons                 2.1.0+2b5a2f1b52 	b63 current b61 b48 setup
      + ./ups/eupspkg VERBOSE=0 FLAVOR=Linux64 fetch
      fatal: reference is not a tree: c9d884655a24deb7cf4b96ee8af4753d737b1377
      + exit -1
      eups distrib: Failed to build sconsUtils-6.2.0.0_16_gc9d884655a+759c3944a1.eupspkg: Command:
      	source /opt/qserv/eups/bin/setups.sh; export EUPS_PATH=/opt/qserv/stack; (/opt/qserv/stack/EupsBuildDir/Linux64/sconsUtils-6.2.0.0_16_gc9d884655a+759c3944a1/build.sh) >> /opt/qserv/stack/EupsBuildDir/Linux64/sconsUtils-6.2.0.0_16_gc9d884655a+759c3944a1/build.log 2>&1 4>/opt/qserv/stack/EupsBuildDir/Linux64/sconsUtils-6.2.0.0_16_gc9d884655a+759c3944a1/build.msg 
      exited with code 255

      indeed the specified commit hash doesn't seem to exists in sconsUtils git repo :

      fjammes@clrlsst-dbmaster-vm:~/tmp $ git clone git://git.lsstcorp.org/LSST/DMS/devenv/sconsUtils.git
      Initialized empty Git repository in /home/fjammes/tmp/sconsUtils/.git/
      remote: Counting objects: 2064, done.
      remote: Compressing objects: 100% (1272/1272), done.
      remote: Total 2064 (delta 839), reused 1248 (delta 477)
      Receiving objects: 100% (2064/2064), 336.90 KiB | 285 KiB/s, done.
      Resolving deltas: 100% (839/839), done.
      fjammes@clrlsst-dbmaster-vm:~/tmp $ cd sconsUtils/
      fjammes@clrlsst-dbmaster-vm:~/tmp/sconsUtils (master) $ git checkout c9d884655a24deb7cf4b96ee8af4753d737b137
      error: pathspec 'c9d884655a24deb7cf4b96ee8af4753d737b137' did not match any file(s) known to git.

      Two questions here :

      • if there's effectively a problem in scons/sconsUtils packaging, is it please possible to fix it ?
      • would it be possible to define a "current" tag for sconsUtils (like git), in order to ease its install and not to have to specified its version in Qserv install script ?

      Thanks, and have a nice day,

        Attachments

          Issue Links

            Activity

            Hide
            mjuric Mario Juric added a comment -

            Fabrice, try this:

            • You're pointing to the wrong distribution server – since the release last week, the URL is: http://sw.lsstcorp.org/eupspkg. Also make sure you're using EUPS 1.3.0.
            • I see you have many bNNN tags in your repository; those were all test builds and shouldn't be kept around. I'd rebuild from scratch.
            • The distserver at sw.lsstcorp.org has the 'current' tag set, so you should be able to install sconsUtils w/o specifying the version.

            Let me know if this helped.

            Show
            mjuric Mario Juric added a comment - Fabrice, try this: You're pointing to the wrong distribution server – since the release last week, the URL is: http://sw.lsstcorp.org/eupspkg . Also make sure you're using EUPS 1.3.0. I see you have many bNNN tags in your repository; those were all test builds and shouldn't be kept around. I'd rebuild from scratch. The distserver at sw.lsstcorp.org has the 'current' tag set, so you should be able to install sconsUtils w/o specifying the version. Let me know if this helped.
            Hide
            jammes Fabrice Jammes added a comment -

            Hello Mario,

            It works fine now , thanks to you.

            Show
            jammes Fabrice Jammes added a comment - Hello Mario, It works fine now , thanks to you.
            Hide
            mjuric Mario Juric added a comment -

            Great!

            Show
            mjuric Mario Juric added a comment - Great!

              People

              • Assignee:
                mjuric Mario Juric
                Reporter:
                jammes Fabrice Jammes
                Watchers:
                Fabrice Jammes, Jacek Becla, Mario Juric
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel