Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-40309

SAL Kafka - Test programs and TTS/CI deployment

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: Middleware
    • Labels:
      None

      Description

      Continue with local build and SAL test programs, generate RPM assets, support CI and TTS deployments, discuss schema repo strategy

        Attachments

          Activity

          Ascending order - Click to sort in descending order
          Hide
          Permalink
          dmills Dave Mills added a comment -

          Finally made some decent progress and got the C++ test programs to build and run.
          Tested against a Confluent container as it provides some useful monitoring and debug capability. Discussed this with Angelo and he is going to add Kafdrop to his development container and I will switch to that. Also has some discussions with Tiago/Angelo/Tony regarding the XML and Schema strategy. We agreed to move the schema generation to the XML package (Tiago will look at making sure it generates Json which is compatible with the Avro code generation tools - I sent him samples for ATPtg). Early tests indicated a solid
          1ms latency (local) for simple event messages and I am working on a more representative set.

          Show
          dmills Dave Mills added a comment - Finally made some decent progress and got the C++ test programs to build and run. Tested against a Confluent container as it provides some useful monitoring and debug capability. Discussed this with Angelo and he is going to add Kafdrop to his development container and I will switch to that. Also has some discussions with Tiago/Angelo/Tony regarding the XML and Schema strategy. We agreed to move the schema generation to the XML package (Tiago will look at making sure it generates Json which is compatible with the Avro code generation tools - I sent him samples for ATPtg). Early tests indicated a solid 1ms latency (local) for simple event messages and I am working on a more representative set.
          Hide
          Permalink
          aclements Andy Clements added a comment -

          Fabulous progress Dave!  keep up the good work.

          Show
          aclements Andy Clements added a comment - Fabulous progress Dave!  keep up the good work.

            People

            Assignee:
            dmills Dave Mills
            Reporter:
            dmills Dave Mills
            Reviewers:
            Andy Clements
            Watchers:
            Andy Clements, Dave Mills
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Jenkins

                No builds found.