Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-32453

Add a Watcher alarm for MT Hexapod temperature.

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
    • Story Points:
      3
    • Sprint:
      TSSW Sprint - Oct 25 - Nov 08
    • Team:
      Telescope and Site
    • Urgent?:
      No

      Description

      Add a new Watcher alarm for MT Hexapod strut temperature.

      Make it a generic over-temperature alarm that uses temperature data from the ESS telemetry topic. Details:

      • Base the alarm on the most pessimistic reading.
      • Make the name of the item being monitored configurable.
      • Make the sensors to read configurable, with a configurable display name for each sensor (e.g. strut 1 for the hexapod).
      • Include 3 thresholds: warning, serious, and critical. Typically only 2 of them will be used (by making the third impossible to reach or nan).
      • Include one hysteresis.

        Attachments

          Issue Links

            Activity

            Hide
            rowen Russell Owen added a comment - - edited

            I also made the following improvements:

            • Added a ThresholdHandler class to handle much of the work of ESS-based rules.
            • Simplified the concrete filtered topic wrappers, making them specific to the ESS (they were more general than necessary).

            In future work I hope to write a class to publish data for ESS alarm rule unit tests. Until then I'm only using multi-channel temperature topics because it's too much work to write a mix of those and humidity sensor temperatures (especially when picking a random value to be the pessimistic value).

            Pull request: https://github.com/lsst-ts/ts_watcher/pull/42

            Show
            rowen Russell Owen added a comment - - edited I also made the following improvements: Added a ThresholdHandler class to handle much of the work of ESS-based rules. Simplified the concrete filtered topic wrappers, making them specific to the ESS (they were more general than necessary). In future work I hope to write a class to publish data for ESS alarm rule unit tests. Until then I'm only using multi-channel temperature topics because it's too much work to write a mix of those and humidity sensor temperatures (especially when picking a random value to be the pessimistic value). Pull request: https://github.com/lsst-ts/ts_watcher/pull/42
            Hide
            wvreeven Wouter van Reeven added a comment -

            Reviewed in GitHub. Impressive work!

            Show
            wvreeven Wouter van Reeven added a comment - Reviewed in GitHub. Impressive work!
            Hide
            rowen Russell Owen added a comment -

            I made the suggested updates (thanks for catching those). Jenkins is failing due to the known issue that ts_sal and ts_xml don't agree with each other but tests pass locally.

            Release awaits ts_xml 10.1. I'll use DM-32270 for the releases

            Show
            rowen Russell Owen added a comment - I made the suggested updates (thanks for catching those). Jenkins is failing due to the known issue that ts_sal and ts_xml don't agree with each other but tests pass locally. Release awaits ts_xml 10.1. I'll use DM-32270 for the releases
            Hide
            dneill Doug Neill added a comment -

            Regarding hysteresis, I do agree with need to include this whenever the alarm produces an action such as disabling the hexapod. Otherwise you can get excessively cycling. However, for a warning where no action is taken excessive cycling should not result and there is no real need to account for hysteresis. There is no real problem with a warning going on and off. Accounting for the hysteresis doesn't really cause any problems either so if you want to that is fine also.

            Show
            dneill Doug Neill added a comment - Regarding hysteresis, I do agree with need to include this whenever the alarm produces an action such as disabling the hexapod. Otherwise you can get excessively cycling. However, for a warning where no action is taken excessive cycling should not result and there is no real need to account for hysteresis. There is no real problem with a warning going on and off. Accounting for the hysteresis doesn't really cause any problems either so if you want to that is fine also.
            Hide
            rowen Russell Owen added a comment - - edited

            I think even cycling of warnings will annoy the operators and make them stop paying attention. In any case I use one hysteresis value for all threshold levels, to simplify configuration.

            Note: I have updated all ESS-based rules to allow specifying 3 thresholds: warning, serious, and critical. My assumption is that we will configure at most two of those levels (leaving the others unused). This allow us to make highest severity serious or critical by changing the configuration, which gives maximum flexibility. I am writing the configurations on DM-32495.

            Show
            rowen Russell Owen added a comment - - edited I think even cycling of warnings will annoy the operators and make them stop paying attention. In any case I use one hysteresis value for all threshold levels, to simplify configuration. Note: I have updated all ESS-based rules to allow specifying 3 thresholds: warning, serious, and critical. My assumption is that we will configure at most two of those levels (leaving the others unused). This allow us to make highest severity serious or critical by changing the configuration, which gives maximum flexibility. I am writing the configurations on DM-32495 .

              People

              Assignee:
              rowen Russell Owen
              Reporter:
              rowen Russell Owen
              Reviewers:
              Wouter van Reeven
              Watchers:
              Doug Neill, Holger Drass, Russell Owen, Wouter van Reeven
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.