Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-5845

ci_hsc fails with "too many open files"

    Details

    • Type: Bug
    • Status: To Do
    • Resolution: Unresolved
    • Fix Version/s: None
    • Component/s: ci_hsc

      Description

      For example, with thanks to Michael Wood-Vasey:

                    ci_hsc: master-g78db638f21 .....................................................................................ERROR (207 sec).
      *** error building product ci_hsc.
      *** exit code = 2
      *** log is in /Users/wmwv/lsstsw/build/ci_hsc/_build.log
      *** last few lines:
      :::::  [2016-04-25T19:25:59.824660Z]     jobs.run(postfunc = jobs_postfunc)
      :::::  [2016-04-25T19:25:59.824699Z]   File "/Users/wmwv/lsstsw/stack/DarwinX86/scons/2.3.5/lib/scons/SCons/Job.py", line 113:
      :::::  [2016-04-25T19:25:59.824709Z]     postfunc()
      :::::  [2016-04-25T19:25:59.824752Z]   File "/Users/wmwv/lsstsw/stack/DarwinX86/scons/2.3.5/lib/scons/SCons/Script/Main.py", line 1294:
      :::::  [2016-04-25T19:25:59.824767Z]     SCons.SConsign.write()
      :::::  [2016-04-25T19:25:59.824808Z]   File "/Users/wmwv/lsstsw/stack/DarwinX86/scons/2.3.5/lib/scons/SCons/SConsign.py", line 109:
      :::::  [2016-04-25T19:25:59.824816Z]     None
      :::::  [2016-04-25T19:25:59.824869Z]   File "/Users/wmwv/lsstsw/stack/DarwinX86/scons/2.3.5/lib/scons/SCons/dblite.py", line 116:
      :::::  [2016-04-25T19:25:59.824878Z]     None
      :::::  [2016-04-25T19:25:59.935601Z] Exception IOError: (24, 'Too many open files', '.sconsign.tmp') in <bound method dblite.__del__ of <SCons.dblite.dblite object at 0x10dfe9c50>> ignored
      

      Possibly only happens on OSX?

        Attachments

          Activity

          Hide
          wmwood-vasey Michael Wood-Vasey added a comment -

          Happens either through lsstsw based rebuild -u ci_hsc or directly building from source with a recent (last week's) stack.

          Show
          wmwood-vasey Michael Wood-Vasey added a comment - Happens either through lsstsw based rebuild -u ci_hsc or directly building from source with a recent (last week's) stack.
          Hide
          tjenness Tim Jenness added a comment -

          I assume it has worked previously on OS X though?

          Show
          tjenness Tim Jenness added a comment - I assume it has worked previously on OS X though?
          Hide
          wmwood-vasey Michael Wood-Vasey added a comment -

          Yes, it certainly has.

          Show
          wmwood-vasey Michael Wood-Vasey added a comment - Yes, it certainly has.
          Hide
          swinbank John Swinbank added a comment -

          This has been an intermittent fault going back for some time, though: it's not a new occurrence. I'm pretty sure failures are linked to what else is running on the machine at the time and/or the level of parallelism applied (ie scons -j).

          Show
          swinbank John Swinbank added a comment - This has been an intermittent fault going back for some time, though: it's not a new occurrence. I'm pretty sure failures are linked to what else is running on the machine at the time and/or the level of parallelism applied (ie scons -j ).
          Hide
          pschella Pim Schellart [X] (Inactive) added a comment -

          FYI http://krypted.com/mac-os-x/maximum-files-in-mac-os-x/

          But I suspect the better fix is to reduce the number of opened files.

          Show
          pschella Pim Schellart [X] (Inactive) added a comment - FYI http://krypted.com/mac-os-x/maximum-files-in-mac-os-x/ But I suspect the better fix is to reduce the number of opened files.

            People

            • Assignee:
              swinbank John Swinbank
              Reporter:
              swinbank John Swinbank
              Watchers:
              John Swinbank, Michael Wood-Vasey, Paul Price, Pim Schellart [X] (Inactive), Tim Jenness
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:

                Summary Panel