Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-27274

Add Kafdrop to argocd-efd deployment

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      kafdrop is an open-source web UI for kafka and can replace some of the functionalities of Control Center.

      After evaluating the existing open source options and in particular trying kafdrop as part of the kafka-aggregator work DM-25676 we decided to use kafdrop for Kafka monitoring.

      See also this article about kafdrop.

        Attachments

          Issue Links

          relates to

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-27376 Kafka monitoring sprint presentation and kafdrop demo

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-27399 Send Kafka JMX metrics to InfluxDB using the Telegraf Prometheus input plugin

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-25676 Evaluate kafdrop UI

          • Done

            Activity

            Ascending order - Click to sort in descending order
            Hide
            Permalink
            afausti Angelo Fausti added a comment - - edited

            Kafdrop successfully added to the sandbox environment: https://kafdrop-sandbox-efd.lsst.codes/ I've put oauth2_proxy in front of it because it is configured with -topic.deleteEnabled=true and -topic.createEnabled=true.

            Rolling out to the other EFD environments.

            Show
            afausti Angelo Fausti added a comment - - edited Kafdrop successfully added to the sandbox environment: https://kafdrop-sandbox-efd.lsst.codes/ I've put oauth2_proxy in front of it because it is configured with -topic.deleteEnabled=true and -topic.createEnabled=true . Rolling out to the other EFD environments.
            Hide
            Permalink
            afausti Angelo Fausti added a comment -

            Kafdrop is deployed in all functional EFD environments:

            Tucson test stand EFD is going to be redeployed when the new k8s cluster is ready.

            Show
            afausti Angelo Fausti added a comment - Kafdrop is deployed in all functional EFD environments: https://kafdrop-sandbox-efd.lsst.codes/ https://kafdrop-base-efd.lsst.codes/ https://kafdrop-summit-efd.lsst.codes/ https://lsst-kafka-0-nts-efd.ncsa.illinois.edu/ Tucson test stand EFD is going to be redeployed when the new k8s cluster is ready.
            Hide
            Permalink
            afausti Angelo Fausti added a comment -

            Confluent Control Center was disabled in all environments and the confluent_controlcenter* topics were deleted.

            Show
            afausti Angelo Fausti added a comment - Confluent Control Center was disabled in all environments and the confluent_controlcenter * topics were deleted.
            Hide
            Permalink
            afausti Angelo Fausti added a comment -

            Deleted old records from Route53

            • control-center-base-efd.lsst.codes
            • control-center-sandbox-efd.lsst.codes
            • control-center-summit-efd.lsst.codes
            • lsst-control-center-nts-efd.lsst.codes
            Show
            afausti Angelo Fausti added a comment - Deleted old records from Route53 control-center-base-efd.lsst.codes control-center-sandbox-efd.lsst.codes control-center-summit-efd.lsst.codes lsst-control-center-nts-efd.lsst.codes
            Hide
            Permalink
            afausti Angelo Fausti added a comment -

            Updated SQR-034 with new URLs for Kafdrop.

            Show
            afausti Angelo Fausti added a comment - Updated SQR-034 with new URLs for Kafdrop.

              People

              Assignee:
              afausti Angelo Fausti
              Reporter:
              afausti Angelo Fausti
              Watchers:
              Angelo Fausti
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.