Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-28873

Send MirrorMaker 2 metrics to InfluxDB for monitoring

    XMLWordPrintable

    Details

    • Type: Story
    • Status: To Do
    • Resolution: Unresolved
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      In DM-27399 we showed how to send Kafka JMX metrics to InfluxDB using the Telegraf Prometheus input plugin.

      We'll use that to monitor Mirror Maker 2 metrics. From KIP-382 there are these metrics available:

      • replication-latency-ms(-avg/-min/-max): timespan between each record's timestamp and downstream ACK
      • record-bytes(-avg/-min/-max): size of each record being replicated
      • record-age-ms(-avg/-min/-max): age of each record when consumed
      • record-count: number of records replicated
      • checkpoint-latency-ms(-avg/-min/-max): timestamp between consumer group commit and downstream checkpoint ACK

        Attachments

          Issue Links

            Activity

            Hide
            afausti Angelo Fausti added a comment -

            Still relevant but must be planned for another epic. Moving to my backlog for now.

            Show
            afausti Angelo Fausti added a comment - Still relevant but must be planned for another epic. Moving to my backlog for now.

              People

              Assignee:
              afausti Angelo Fausti
              Reporter:
              afausti Angelo Fausti
              Watchers:
              Angelo Fausti
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Dates

                Created:
                Updated:

                  Jenkins

                  No builds found.