Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-34878

Modify the code such that the ESS CSC and Controller truely can be stopped and restarted

    XMLWordPrintable

    Details

    • Story Points:
      2
    • Epic Link:
    • Sprint:
      TSSW Sprint - May 23 - Jun 06
    • Team:
      Telescope and Site
    • Urgent?:
      No

      Description

      Despite earlier attempts the ESS CSC and Controller still cannot be reliably stopped and restarted. This ticket is for

      1. Making sure that the ESS CSC can recover from FAULT state and reconnect to the Controller
      2. Making sure that the ESS CSC doesn't go to FAULT state immediately but is more robust for network hick ups
      3. Making sure that the ESS Controller doesn't refuse new incoming connections so that it doesn't have to be restarted if the CSC goes to FAULT state
      4. Making sure that the ESS CSC reloads the configuration when set to STANDBY and then to ENABLED.

        Attachments

          Issue Links

          relates to

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-34900 In ts_tcpip work around the issue that wait_close can hang on stream writers

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-34633 Improve stability of the connection between the ESS CSC and Controller

          • Won't Fix

            Activity

            Ascending order - Click to sort in descending order
            Hide
            Permalink
            wvreeven Wouter van Reeven added a comment -

            Bullet 1 was tested with a mock device over the internet which showed that under normal circumstances the CSC can reconnect without any issues.

            Show
            wvreeven Wouter van Reeven added a comment - Bullet 1 was tested with a mock device over the internet which showed that under normal circumstances the CSC can reconnect without any issues.
            Hide
            Permalink
            wvreeven Wouter van Reeven added a comment -

            Bullet 3 is covered by DM-34900.

            Show
            wvreeven Wouter van Reeven added a comment - Bullet 3 is covered by DM-34900 .
            Hide
            Permalink
            wvreeven Wouter van Reeven added a comment -

            Bullet 4 was tested with a mock device over the internet which showed that under normal circumstances the CSC reloads the configuration when set to STANDBY and then to ENABLED again.

            Show
            wvreeven Wouter van Reeven added a comment - Bullet 4 was tested with a mock device over the internet which showed that under normal circumstances the CSC reloads the configuration when set to STANDBY and then to ENABLED again.
            Hide
            Permalink
            wvreeven Wouter van Reeven added a comment -

            Bullet 2 was implemented in ts_ess_common and ts_ess_csc.

            Show
            wvreeven Wouter van Reeven added a comment - Bullet 2 was implemented in ts_ess_common and ts_ess_csc.
            Hide
            Permalink
            wvreeven Wouter van Reeven added a comment -

            The ESS CSCs have been running stably for a week now and no timeouts have been seen. I prefer to leave the timeout at 60 seconds for now until we are sure that this has been solved.

            ts_ess_common PR: https://github.com/lsst-ts/ts_ess_common/pull/14

            ts_ess_csc PR: https://github.com/lsst-ts/ts_ess_csc/pull/64

            Show
            wvreeven Wouter van Reeven added a comment - The ESS CSCs have been running stably for a week now and no timeouts have been seen. I prefer to leave the timeout at 60 seconds for now until we are sure that this has been solved. ts_ess_common PR: https://github.com/lsst-ts/ts_ess_common/pull/14 ts_ess_csc PR: https://github.com/lsst-ts/ts_ess_csc/pull/64
            Hide
            Permalink
            rowen Russell Owen added a comment -

            Reviewed on github

            Show
            rowen Russell Owen added a comment - Reviewed on github

              People

              Assignee:
              wvreeven Wouter van Reeven
              Reporter:
              wvreeven Wouter van Reeven
              Reviewers:
              Russell Owen
              Watchers:
              Russell Owen, Wouter van Reeven
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.