Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-25808

There's always one message behind on each partition consumed by the Faust consumers

    XMLWordPrintable

    Details

    • Type: Story
    • Status: To Do
    • Resolution: Unresolved
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      After the producer stops producing messages and kafka-aggregator worker finishes processing the stream, there's always one message behind on each partition consumed by the Faust consumers. See screenshot. Needs more investigation.

        Attachments

          Issue Links

          relates to

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-25671 Deploy de kafka-aggregator on the Sandox EFD environment

          • Done

            Activity

            Hide
            Permalink
            afausti Angelo Fausti added a comment -

            100 topics with 4 partitions each, consumer lag shows one message behind for each partition thus a total lag of 400 messages behind.

            Show
            afausti Angelo Fausti added a comment - 100 topics with 4 partitions each, consumer lag shows one message behind for each partition thus a total lag of 400 messages behind.

              People

              Assignee:
              afausti Angelo Fausti
              Reporter:
              afausti Angelo Fausti
              Watchers:
              Angelo Fausti
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Dates

                Created:
                Updated:

                  Jenkins

                  No builds found.