Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-271 Setup the new Buildbot CI system
  3. DM-479

A stack rebuild should be automatically initiated whenever git repository master branch has been updated.

    Details

    • Sprint:
      DevOps Sprint 1, DevOps Sprint 2, DevOps Sprint 3
    • Team:
      SQuaRE

      Description

      When the master branch of any LSST stack source repository has been updated, buildbot should initiate a stack rebuild of the master branch.

        Attachments

          Issue Links

            Activity

            Hide
            robyn Robyn Allsman [X] (Inactive) added a comment -

            Mario, The relevant cron job handling this functionality is a 98% clone from your cron script. This reveiw shouldn't take much of your time.

            Relevant info:

            • git@git.lsstcorp.org:LSST/DMS/devenv/buildbot/scripts/
              • forceBuild-cron - directly called by cron to check locks and then initiate build if git-source changed since last cron-check.
              • forceBuild.py - initiates a web request to the Buildbot DM_stack ForceBuild page which initiates a build.
            • these scripts are installed in ~lsstsw/bin/

            Relevant ticket branch: DM-271 for source changes.

            Show
            robyn Robyn Allsman [X] (Inactive) added a comment - Mario, The relevant cron job handling this functionality is a 98% clone from your cron script. This reveiw shouldn't take much of your time. Relevant info: git@git.lsstcorp.org:LSST/DMS/devenv/buildbot/scripts/ forceBuild-cron - directly called by cron to check locks and then initiate build if git-source changed since last cron-check. forceBuild.py - initiates a web request to the Buildbot DM_stack ForceBuild page which initiates a build. these scripts are installed in ~lsstsw/bin/ Relevant ticket branch: DM-271 for source changes.
            Hide
            mjuric Mario Juric added a comment -

            Two questions/comments:

            • Are we building anything from Stash? If yes, the gitolite last-write ADC won't detect if anything changed there
            • Is 'mechanize' now required to run buildbot? How does one obtain it?
            Show
            mjuric Mario Juric added a comment - Two questions/comments: Are we building anything from Stash? If yes, the gitolite last-write ADC won't detect if anything changed there Is 'mechanize' now required to run buildbot? How does one obtain it?
            Hide
            robyn Robyn Allsman [X] (Inactive) added a comment -

            Good points.

            Re Item 1: Stash use and access
            ____________________________
            OK, I've opened a new issue: DM-955 for triggering on stash source changes. Simon has been hand triggering when he's updates source.

            Simon also reminds us that stash does not allow anonymous git cloning via ssh.

            Here's an ugly workaround (circa 2012): https://answers.atlassian.com/questions/101935/is-it-possible-to-provide-anonymous-access-to-a-stash-hosted-git-repository

            Here's the current Atlassian state of play:
            https://confluence.atlassian.com/display/STASH/Allowing+public+access+to+code

            Re Item 2:
            __________
            mechanize was acquired from pypi: http://pypi.python.org/packages/source/m/mechanize/mechanize-0.2.5.tar.gz

            Additional software enabling the buildbot / DM Continuous Integration interface includes:
            buildbot-master-0.8.8, buildbot-slave-0.8.8, TwistedCore-13.2.0, zope.interface-4.1.1

            I am including them in a new Buildbot Installation Guide – currently in my space on confluence.

            Show
            robyn Robyn Allsman [X] (Inactive) added a comment - Good points. Re Item 1: Stash use and access ____________________________ OK, I've opened a new issue: DM-955 for triggering on stash source changes. Simon has been hand triggering when he's updates source. Simon also reminds us that stash does not allow anonymous git cloning via ssh. Here's an ugly workaround (circa 2012): https://answers.atlassian.com/questions/101935/is-it-possible-to-provide-anonymous-access-to-a-stash-hosted-git-repository Here's the current Atlassian state of play: https://confluence.atlassian.com/display/STASH/Allowing+public+access+to+code Re Item 2: __________ mechanize was acquired from pypi: http://pypi.python.org/packages/source/m/mechanize/mechanize-0.2.5.tar.gz Additional software enabling the buildbot / DM Continuous Integration interface includes: buildbot-master-0.8.8, buildbot-slave-0.8.8, TwistedCore-13.2.0, zope.interface-4.1.1 I am including them in a new Buildbot Installation Guide – currently in my space on confluence.

              People

              • Assignee:
                robyn Robyn Allsman [X] (Inactive)
                Reporter:
                robyn Robyn Allsman [X] (Inactive)
                Reviewers:
                Mario Juric
                Watchers:
                Mario Juric
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel

                    Time Tracking

                    Estimated:
                    Original Estimate - 3 days
                    3d
                    Remaining:
                    Remaining Estimate - 0 minutes
                    0m
                    Logged:
                    Time Spent - 3 days
                    3d