Quantcast
Channel: Re: A question about possible race condition
Browsing all 5 articles
Browse latest View live

Re: A question about possible race condition

One more possible race might happen when the partition number is fixed but consumer(s) are added/removed For example: If I have a consumer reading data from two partitions (partition one and partition...

View Article



Re: A question about possible race condition

Guy, Yes, this is possible. One solution that we have been thinking about is that if a rebalance happens, each consumer can somehow get a callback that indicates the set of partitions being consumed...

View Article

Re: A question about possible race condition

Jun, I'm not sure that's enough. A callback may not be enough since we can't be sure that there are no events from that partition being processed while the new consumer starts processing events from...

View Article

Re: A question about possible race condition

Jun, On that note, waiting to consumer's acknowledgment can be with configurable timeout ranging from blocking to not wait at all Thanks, Guy -- Guy Peleg

View Article

Re: A question about possible race condition

Then, you may be interested in our consume client redesign: https://cwiki.apache.org/confluence/display/KAFKA/Consumer+Client+Re-Design Thanks, Jun -- Jun Rao

View Article

Browsing all 5 articles
Browse latest View live




Latest Images