Kafka

OffsetOutOfRangeException

We have noticed an issue with Kafka related to the OffsetOutOfRangeException, when running the indexer in isolation.level: read_committed. This appears to be a known issue with Kafka and hung transactions (see https://blog.digitalis.io/hung-kafka-transactions-3cdf9ca158ff, https://cwiki.apache.org/confluence/display/KAFKA/KIP-890%3A+Transactions+Server-Side+Defense, https://issues.apache.org/jira/browse/KAFKA-14402). While originally planned to be resolved in Kafka 3.7.0 this ended up not shipping in this version. As mentioned in resources above, if your issue is related to a hung transaction there are built-in Kafka scripts you can use to identify and resolve this issue, until a proper fix is shipped in a later version of Kafka.