Status: To Do
Fix Version/s: None
Roundtable apps integrate with SQuaRE Events (Kafka) as an integral part of their functionality. However, we don't have a real solution for fully testing these apps in CI (aside from avoiding testing the parts that interact with Kafka). Up to this point, we've been testing Kafka apps by iteratively developing them against a real Kafka cluster. This ticket is to build a more mature testing framework that can run in CI (such as GitHub Actions).
- Make use of Docker to run Kafka and the Confluent Schema Registry in CI
- https://github.com/tox-dev/tox-docker lets one run Docker containers in conjunction with a tox environment
- https://github.com/aio-libs/aiokafka/tree/master/docker is prior art for single-node Kafka in Docker.
I think that Kafkit should host the core elements of this testing infrastructure, such as building the Docker images and documenting how to use them.
- relates to
DM-23731 Create microservice for LSST the Docs that sends events to Roundtable Events (Kafka)