Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-27186

Fix the cache-max-memory-size exceeded error

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      We saw this in one of the kafka-connect pods:

      [2020-10-14 19:05:36,365] ERROR Encountered error engine: cache-max-memory-size exceeded: (1073761365/1073741824) (com.datamountaineer.streamreactor.connect.influx.writers.InfluxDbWriter)

      It is a configuration on the InfluxDB side. Looks like we exceeded the cache-max-memory-size which is set to 1G - we are probably sending large volumes of data specially after the connector entered the UNASSIGNED state.

      I think it is fine to set it to 0 to disable this limit.

        Attachments

          Activity

          Hide
          Permalink
          afausti Angelo Fausti added a comment -

          Setting cache-max-memory-size to 0 disables this limit. Tested this in the InfluxDB deployment at NTS and then updated this configuration elsewhere.

          Show
          afausti Angelo Fausti added a comment - Setting cache-max-memory-size to 0 disables this limit. Tested this in the InfluxDB deployment at NTS and then updated this configuration elsewhere.

            People

            Assignee:
            afausti Angelo Fausti
            Reporter:
            afausti Angelo Fausti
            Watchers:
            Angelo Fausti
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Jenkins

                No builds found.