Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-23064

Deploy an instance of the EFD at the NCSA test stand

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: efd
    • Labels:
      None

      Description

      Another instance of the EFD needs to be deployed at the NCSA test stand (see https://sqr-031.lsst.io/)

      The machine lsst-l1-cl-efd (141.124.238.172) was reserved for that initially. It satisfies the basic requirements to run a test stand deployment on Kubes (k3s) i.e. 16 cores, 45 GB memory, 1.8TB disk.

      However, we run into firewall issues that prevented k3s to work.  

      It was decided that this deployment should be done in a new k8s cluster at the NCSA test stand.

       

        Attachments

          Issue Links

            Activity

            Hide
            afausti Angelo Fausti added a comment -

            Fixed the cp-helm-charts chart to make it compatible with Kubernetes 1.16 in DM-23229

            Show
            afausti Angelo Fausti added a comment - Fixed the cp-helm-charts chart to make it compatible with Kubernetes 1.16 in DM-23229
            Hide
            afausti Angelo Fausti added a comment -

            All services are accessible now, the main endpoints are:

            Chronograf: https://lsst-chronograf-nts-efd.ncsa.illinois.edu 
            InfluxDB: https://lsst-influxdb-nts-efd.ncsa.illinois.edu 
            

            Tiago Ribeiro to configure the SAL Kafka producer to send data to the NCSA test stand EFD, you'll need the Kafka Schema Registry: https://lsst-schema-registry-nts-efd.ncsa.illinois.edu and access to the Kafka broker at lsst-kafka-0-nts-efd.ncsa.illinois.edu:31090

            I've just tested the EFD (https://sqr-031.lsst.io/#testing-the-efd) and I can reach both the Kafka schema registry and the Kafka broker, example:

            docker run -it --network=host edenhill/kafkacat:1.5.0 -b lsst-kafka-0-nts-efd.ncsa.illinois.edu:31090 -L
            

            Show
            afausti Angelo Fausti added a comment - All services are accessible now, the main endpoints are: Chronograf: https://lsst-chronograf-nts-efd.ncsa.illinois.edu InfluxDB: https://lsst-influxdb-nts-efd.ncsa.illinois.edu Tiago Ribeiro to configure the SAL Kafka producer to send data to the NCSA test stand EFD, you'll need the Kafka Schema Registry: https://lsst-schema-registry-nts-efd.ncsa.illinois.edu and access to the Kafka broker at lsst-kafka-0-nts-efd.ncsa.illinois.edu:31090 I've just tested the EFD ( https://sqr-031.lsst.io/#testing-the-efd ) and I can reach both the Kafka schema registry and the Kafka broker, example: docker run -it --network=host edenhill/kafkacat:1.5.0 -b lsst-kafka-0-nts-efd.ncsa.illinois.edu:31090 -L
            Hide
            afausti Angelo Fausti added a comment -

            Kapacitor is also working fine on the NCSA test stand.

            Show
            afausti Angelo Fausti added a comment - Kapacitor is also working fine on the NCSA test stand.
            Hide
            afausti Angelo Fausti added a comment -

            SAL Kafka producers are sending data.

            I've fixed a small issue with the connector configuration that was pointing to the wrong InfluxDB URL.

            Show
            afausti Angelo Fausti added a comment - SAL Kafka producers are sending data. I've fixed a small issue with the connector configuration that was pointing to the wrong InfluxDB URL.
            Hide
            afausti Angelo Fausti added a comment -

            SQR-034 was updated with information for this instance.

            Show
            afausti Angelo Fausti added a comment - SQR-034 was updated with information for this instance.

              People

              • Assignee:
                afausti Angelo Fausti
                Reporter:
                afausti Angelo Fausti
                Watchers:
                Angelo Fausti, Matthew Thomas Long, Michael Reuter, Michelle Butler
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: