Re: A question about possible race condition
One more possible race might happen when the partition number is fixed but consumer(s) are added/removed For example: If I have a consumer reading data from two partitions (partition one and partition...
View ArticleRe: A question about possible race condition
Guy, Yes, this is possible. One solution that we have been thinking about is that if a rebalance happens, each consumer can somehow get a callback that indicates the set of partitions being consumed...
View ArticleRe: A question about possible race condition
Jun, I'm not sure that's enough. A callback may not be enough since we can't be sure that there are no events from that partition being processed while the new consumer starts processing events from...
View ArticleRe: A question about possible race condition
Jun, On that note, waiting to consumer's acknowledgment can be with configurable timeout ranging from blocking to not wait at all Thanks, Guy -- Guy Peleg
View ArticleRe: A question about possible race condition
Then, you may be interested in our consume client redesign: https://cwiki.apache.org/confluence/display/KAFKA/Consumer+Client+Re-Design Thanks, Jun -- Jun Rao
View Article
More Pages to Explore .....