Details
-
Type:
Bug
-
Status: Done
-
Resolution: Done
-
Fix Version/s: None
-
Component/s: jenkins
-
Labels:None
-
Team:SQuaRE
Description
run_publish #2621 failed with:
eups distrib: Expanding table for lsst_ci: validation_data_cfht is not setup
|
This then caused the build-stack step of the release to fail with:
Tag d_2019_10_08 not supported at https://eups.lsst.codes/stack/redhat/el7/devtoolset-8/miniconda3-4.5.12-1172c30
|
eups distrib: Product lsst_dm_stack_demo d_2019_10_08 not found in any package repository
|
The failure of lsst_distrib on macOS is yet another gsl build failure and is almost certainly unrelated.
The validation_data_cfht thing was a red herring.
So what happens is the source of truth for eups.lsst.codes is stored in S3, however eups needs it on a filesystem so it is mirrored on a persistent volume on GKE. This PV was sized at 2TB and held the builds since time immemorial... and it filled up.
The partition has been increased and resynced with S3. Too late now to rerun last night's, but tonight's will hopefully go out fine.