Skip to content

Consumer got stuck during offset commit #2099

@OrAbramovich

Description

@OrAbramovich

I am using version 2.0.1 of kafka-python and encountered the following issue: during a manual offset commit there was a networking issue that caused the consumer to hang. Here are the last prints:

[2020-08-05 13:14:44,632] DEBUG 21343 _handle_group_coordinator_response Received group coordinator response GroupCoordinatorResponse_v0(error_code=0, coordinator_id=314123, host='kafka-host', port=1234)
[2020-08-05 13:14:44,632] DEBUG 21343 add_group_coordinator Updating coordinator for my-test-group: GroupCoordinatorResponse_v0(error_code=0, coordinator_id=314123, host='kafka-host', port=1234)
[2020-08-05 13:14:44,633] INFO 21343 add_group_coordinator Group coordinator for my-test-group is BrokerMetadata(nodeId='coordinator-314123', host='kafka-host', port=1234, rack=None)
[2020-08-05 13:14:44,633] INFO 21343 _handle_group_coordinator_response Discovered coordinator coordinator-314123 for group my-test-group
[2020-08-05 13:15:12,473] WARNING 21343 _poll <BrokerConnection node_id=coordinator-314123 host=kafka-host:1234 [IPv4 ('10.0.0.10', 1234)]> timed out after 305000 ms. Closing connection.
[2020-08-05 13:15:12,473] INFO 21343 close <BrokerConnection node_id=coordinator-314123 host=kafka-host:1234 [IPv4 ('10.0.0.10', 1234)]>: Closing connection. [Error 7] RequestTimedOutError: Request timed out after 305000 ms
[2020-08-05 13:15:12,474] DEBUG 21343 _update_reconnect_backoff <BrokerConnection node_id=coordinator-314123 host=kafka-host:1234 [IPv4 ('10.0.0.10', 1234)]>: reconnect backoff 0.05205567834004354 after 1 failures
[2020-08-05 13:15:12,474] WARNING 21343 _conn_state_change Node coordinator-314123 connection failed -- refreshing metadata
[2020-08-05 13:15:12,474] ERROR 21343 _failed_request Error sending OffsetCommitRequest_v2 to node coordinator-314123 [[Error 7] RequestTimedOutError: Request timed out after 305000 ms]
[2020-08-05 13:15:12,474] WARNING 21343 coordinator_dead Marking the coordinator dead (node coordinator-314123) for group my-test-group: [Error 7] RequestTimedOutError: Request timed out after 305000 ms.
[2020-08-05 13:15:12,475] ERROR 21343 _failed_request Error sending HeartbeatRequest_v0 to node coordinator-314123 [[Error 7] RequestTimedOutError: Request timed out after 305000 ms]

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions