Details
-
Type:
Story
-
Status: Done
-
Resolution: Done
-
Fix Version/s: None
-
Component/s: Continuous Integration
-
Labels:None
-
Story Points:3
-
Epic Link:
-
Team:SQuaRE
Description
We see errors installing both osx and linux packages like the following:
CondaRuntimeError: Runtime error: RuntimeError: Runtime error: Could not open u'/Users/square/jenkins/workspace/release/tarball/DarwinX86/miniconda2/4.2.12.lsst1/pkgs/mkl-11.3.3-0.tar.bz2.part' for writing (HTTPSConnectionPool(host='repo.continuum.io', port=443): Read timed out.). |
I believe the best resolution is to mirror the public conda channels internally. Another, less desirable, option would be build retrying into the conda command.
Attachments
Issue Links
Activity
DM-5126 would remove usage of the miniconda2/3 EUPS products and install directly. That would cut the code duplication down to 2 places.
New miniconda {{ 4.2.12.lsst2}} git tags have been pushed and eupspkg packages were published.
These were tested as working by running the newinstall.sh PR in a container:
[root@b8dc620f70dd build]# curl -sSL https://raw.githubusercontent.com/jhoblitt/lsst/tickets/DM-9897-conda-channels/scripts/newinstall.sh | bash -s -- -cb |
|
|
LSST Software Stack Builder
|
=======================================================================
|
|
|
diff: bash: No such file or directory
|
|
|
Installing EUPS (v2.1.2)... done. |
Creating user data directory: /root/.eups
|
Installing Miniconda2 Python Distribution ...
|
[ 1/1 ] miniconda2 4.2.12.lsst2 done. |
Installing the basic environment ...
|
[ 1/5 ] doxygen 1.8.5.lsst1 done. |
[ 2/5 ] python 0.0.6 ... |
Using /build/Linux64/miniconda2/4.2.12.lsst2/bin/python (Python 2.7.12 :: Continuum Analytics, Inc.). |
[ 2/5 ] python 0.0.6 done. |
[ 3/5 ] scons 2.5.0.lsst2+1 done. |
[ 4/5 ] sconsUtils 13.0 done. |
[ 5/5 ] lsst 13.0 done. |
Creating startup scripts (bash) ... done.
|
Creating startup scripts (ksh) ... done.
|
Creating startup scripts (csh) ... done.
|
Creating startup scripts (zsh) ... done.
|
|
|
Bootstrap complete. To continue installing (and to use) the LSST stack |
type one of:
|
|
|
source "/build/loadLSST.bash" # for bash |
source "/build/loadLSST.csh" # for csh |
source "/build/loadLSST.ksh" # for ksh |
source "/build/loadLSST.zsh" # for zsh |
|
|
Individual LSST packages may now be installed with the usual `eups
|
distrib install' command. For example, to install the science pipeline
|
elements of the LSST stack, use:
|
|
|
eups distrib install lsst_apps
|
|
|
Next, read the documentation at:
|
|
|
https://pipelines.lsst.io |
|
|
and feel free to ask any questions via the LSST Community forum:
|
|
|
https://community.lsst.org/c/support |
|
|
Thanks!
|
-- The LSST Software Teams
|
http://dm.lsst.org/ |
|
|
[root@b8dc620f70dd build]# . loadLSST.bash |
[root@b8dc620f70dd build]# conda config --show |
add_anaconda_token: True
|
add_pip_as_python_dependency: True
|
allow_softlinks: True
|
always_copy: False
|
always_yes: False
|
auto_update_conda: True
|
binstar_upload: None
|
changeps1: True
|
channel_alias: https://conda.anaconda.org |
channel_priority: True
|
channels:
|
- http://jhoblitt-conda-mirror.lsst.codes/pkgs/free |
client_tls_cert:
|
client_tls_cert_key:
|
create_default_packages: []
|
debug: False
|
default_channels:
|
- https://repo.continuum.io/pkgs/free |
- https://repo.continuum.io/pkgs/pro |
disallow: []
|
envs_dirs:
|
- /build/Linux64/miniconda2/4.2.12.lsst2/envs |
json: False
|
offline: False
|
proxy_servers: {}
|
quiet: False
|
shortcuts: True
|
show_channel_urls: None
|
ssl_verify: True
|
track_features: []
|
update_dependencies: True
|
use_pip: True
|
verbosity: 0 |
|
A production conda mirror finished syncing yesterday evening and support for the production jenkins jobs was merged a few minutes ago. I'm going to leave this ticket open until it is clear that there are no hiccups with production CI.
This appears to be working without incident in production.
They look fine. It's a shame that 3 of the PRs have identical code changes.