Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-4970

Investigate logging, monitoring and metrics technologies and architecture

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Investigate technologies and architectures to use with panopticon, our logging system. Perform preliminary research and evaluations into ELK (Elasticsearch, Logstash and Kibana), extensions to ELK and other alternatives.

        Attachments

          Issue Links

            Activity

            Hide
            jmatt J Matt Peterson [X] (Inactive) added a comment -

            Per a discussion with Frossie Economou at Friday's standup, moved the research and investigation of logging to this epic.

            Show
            jmatt J Matt Peterson [X] (Inactive) added a comment - Per a discussion with Frossie Economou at Friday's standup, moved the research and investigation of logging to this epic.
            Hide
            ktl Kian-Tat Lim added a comment -

            If this is "In Review", shouldn't there be a pointer to the thing (document, presumably, or other concrete deliverable) to be reviewed?

            Show
            ktl Kian-Tat Lim added a comment - If this is "In Review", shouldn't there be a pointer to the thing (document, presumably, or other concrete deliverable) to be reviewed?
            Hide
            jmatt J Matt Peterson [X] (Inactive) added a comment -

            Yeah that is a good idea. I want to wait on a proper tech note until the MVP is out. I can't directly publish my notes, some of my notes will break NDAs (from former employers, or 3rd parties that shared with me). How about a docs directory on the panopticon repository and I'll break up and organize my notes into some markdown / reST that can be public facing.

            Show
            jmatt J Matt Peterson [X] (Inactive) added a comment - Yeah that is a good idea. I want to wait on a proper tech note until the MVP is out. I can't directly publish my notes, some of my notes will break NDAs (from former employers, or 3rd parties that shared with me). How about a docs directory on the panopticon repository and I'll break up and organize my notes into some markdown / reST that can be public facing.
            Hide
            ktl Kian-Tat Lim added a comment -

            I believe that the primary ways to make internal-only information more widely available are 1) Confluence with appropriate page access restrictions, 2) community.lsst.org in the DM Team category, or 3) DocuShare with appropriate document access restrictions. But publishing only public results would likely be fine, too.

            Show
            ktl Kian-Tat Lim added a comment - I believe that the primary ways to make internal-only information more widely available are 1) Confluence with appropriate page access restrictions, 2) community.lsst.org in the DM Team category, or 3) DocuShare with appropriate document access restrictions. But publishing only public results would likely be fine, too.
            Hide
            jmatt J Matt Peterson [X] (Inactive) added a comment -

            I talked to Jonathan Sick. I'll do a technote. Then do a c.l.o post that references the technote (with the specific version, since it'll evolve).

            Show
            jmatt J Matt Peterson [X] (Inactive) added a comment - I talked to Jonathan Sick . I'll do a technote. Then do a c.l.o post that references the technote (with the specific version, since it'll evolve).
            Hide
            jmatt J Matt Peterson [X] (Inactive) added a comment -

            Checked in an initial draft on branch tickets/DM-4970.

            Show
            jmatt J Matt Peterson [X] (Inactive) added a comment - Checked in an initial draft on branch tickets/ DM-4970 .
            Hide
            jmatt J Matt Peterson [X] (Inactive) added a comment -

            Will finish the documentation in Extra 2016.

            Show
            jmatt J Matt Peterson [X] (Inactive) added a comment - Will finish the documentation in Extra 2016.

              People

              • Assignee:
                jmatt J Matt Peterson [X] (Inactive)
                Reporter:
                jmatt J Matt Peterson [X] (Inactive)
                Reviewers:
                Frossie Economou
                Watchers:
                Frossie Economou, J Matt Peterson [X] (Inactive), Kian-Tat Lim
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel