Details
-
Type:
Bug
-
Status: Done
-
Resolution: Done
-
Fix Version/s: None
-
Component/s: None
-
Labels:None
-
Team:Data Release Production
Description
lsst-dev7 has recently (9 August) been updated to use LDAP authentication. I understand that this is being rolled out to all LSST development systems at NCSA shortly.
Following the update, I see failures in some (but not all) unit tests like this:
[swinbank@lsst-dev7 ~]$ . /ssd/lsstsw/stack/loadLSST.bash
|
[swinbank@lsst-dev7 ~]$ setup lsst_apps
|
[swinbank@lsst-dev7 ~]$ eups list -s lsst_apps
|
12.0+28 w_2016_32 current setup
|
[swinbank@lsst-dev7 ~]$ python $PIPE_TASKS_DIR/tests/testProcessCcd.py
|
CameraMapper: Loading registry registry from /ssd/lsstsw/stack/Linux64/obs_test/12.0-5-gcdb69c4+3/data/input/registry.sqlite3
|
|
|
... more elided ...
|
|
|
psf Ixx = 2.8540775242108163, Iyy = 2.17386182921239, Ixy = 0.14400008637208778
|
.File open: /var/lib/sss/mc/passwd
|
F.
|
======================================================================
|
FAIL: testFileDescriptorLeaks (__main__.MemoryTestCase)
|
----------------------------------------------------------------------
|
Traceback (most recent call last):
|
File "/ssd/lsstsw/stack/Linux64/utils/12.0-4-gd869a95/python/lsst/utils/tests.py", line 173, in testFileDescriptorLeaks
|
self.fail("Failed to close %d file%s" % (len(diff), "s" if len(diff) != 1 else ""))
|
AssertionError: Failed to close 1 file
|
|
|
----------------------------------------------------------------------
|
Ran 4 tests in 15.629s
|
|
|
FAILED (failures=1)
|
Bill Glick [X] on HipChat tells me:
/var/lib/sss/mc/passwd is the cache file of for user information with SSSD/LDAP users. I'm unclear how that relates to pipe_tasks unit tests. Every time a user process/session runs, it will open that file and keep it open during that session. I think the test suite needs to be updated to ignore that file. /var/lib/sss/mc/group is also similar. They are memory-mapped cache files used by SSSD.
Please resolve this before LDAP authentication is rolled out to all of the LSST systems at NCSA.
Attachments
Issue Links
Activity
The simple change on utils PR 17 fixes this for me. Not sure if we need something more elaborate.
Minor comment on PR. I'm happy whatever way you go on this.
Thanks; merged.
This is coming from the line:
in lsst.base.Packages. I don't think it's worth tracing much further; this looks like something we're going to have to exclude in https://github.com/lsst/utils/blob/master/python/lsst/utils/tests.py#L180