Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-12379

jenkins release/tarball build timeouts under nightly-release

    Details

    • Type: Bug
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: Continuous Integration
    • Labels:
      None

      Description

      It appears to have become fairly frequent (several times per day) for release/tarball builds triggered by the nightly-release to hit the set 6 hour timeout limit. This is problematic as the reported wall clock time for the pipeline steps within the build seems always be around 3 hours.

      This may be a configuration issue, Eg., wait time in the queue is being counted, or it may be some sort of time accounting and/or display problem.

        Attachments

          Issue Links

            Activity

            Hide
            jhoblitt Joshua Hoblitt added a comment -

            I've opened a PR to "push down" the timeout blocks for all jobs triggered by the weekly/nightly release pipelines. As it is Friday afternoon, I'm going to deffer merging this until Monday.

            Show
            jhoblitt Joshua Hoblitt added a comment - I've opened a PR to "push down" the timeout blocks for all jobs triggered by the weekly/nightly release pipelines. As it is Friday afternoon, I'm going to deffer merging this until Monday.
            Hide
            jhoblitt Joshua Hoblitt added a comment -

            The comprehensive timeout PR has been merged. The existing tag-git-repos job had to be manually deleted in order to convert from a freestyle job to pipeline.

            Show
            jhoblitt Joshua Hoblitt added a comment - The comprehensive timeout PR has been merged. The existing tag-git-repos job had to be manually deleted in order to convert from a freestyle job to pipeline.
            Hide
            jhoblitt Joshua Hoblitt added a comment -

            I'm moving this ticket into review status to follow up tomorrow after the nightly has run.

            Show
            jhoblitt Joshua Hoblitt added a comment - I'm moving this ticket into review status to follow up tomorrow after the nightly has run.
            Hide
            jhoblitt Joshua Hoblitt added a comment -

            The conversion of tag-tag-repos from a freestyle to pipeline job, in order to add proper timeouts, had two fatal breakages in it. I believe the job is now working.

            Show
            jhoblitt Joshua Hoblitt added a comment - The conversion of tag-tag-repos from a freestyle to pipeline job, in order to add proper timeouts, had two fatal breakages in it. I believe the job is now working.
            Hide
            jhoblitt Joshua Hoblitt added a comment -

            These changes appear to functioning as expected in the production env.

            Show
            jhoblitt Joshua Hoblitt added a comment - These changes appear to functioning as expected in the production env.

              People

              • Assignee:
                jhoblitt Joshua Hoblitt
                Reporter:
                jhoblitt Joshua Hoblitt
                Reviewers:
                Joshua Hoblitt
                Watchers:
                Adam Thornton, Frossie Economou, Joshua Hoblitt
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel