Monday, 19 August 2019

kafka settings --- about time


max_poll_interval_ms  this is for how long your consumer will be in rest mode(without polling), you can consider this is the time for your client to process the data. you cannot set this too short, because if your client don't poll(as your client may haven't finished the processing) before the timeout, the client will be consider dead and be removed from consumer group to rebalance.

request.timeout.ms  this is the time clients wait server for response

https://stackoverflow.com/questions/40781548/difference-between-request-timeout-ms-and-timeout-ms-properties-of-kafka-produce


https://kafka.apache.org/documentation/#consumerconfigs


https://juejin.im/post/5bec10ca6fb9a049b13dc1e4


https://stackoverflow.com/questions/53513863/change-kafka-configuration-max-poll-interval-ms-causes-one-consumer-stuck-at-re

No comments:

Post a comment