/Python/Kafka get last offset of topic python

Kafka get last offset of topic python

from kafka import SimpleClient
from kafka.protocol.offset import OffsetRequest, OffsetResetStrategy
from kafka.common import OffsetRequestPayload

client = SimpleClient(brokers)

partitions = client.topic_partitions[topic]
offset_requests = [OffsetRequestPayload(topic, p, -1, 1) for p in partitions.keys()]

offsets_responses = client.send_offset_request(offset_requests)

for r in offsets_responses:
    print "partition = %s, offset = %s"%(r.partition, r.offsets[0])

Source: stackoverflow.com

Similar codes

0 vote160 views2 answers
Python iterator
Python
2 votes142 views3 answers
Why is Python called Python
Python
0 vote166 views2 answers
Python concatenation
Python
0 vote131 views1 answer
TemplateSyntaxError
Python
10 votes123 views2 answers
Selenium refresh page python
Python
1 vote136 views4 answers
Model checkpoint
Python
0 vote140 views1 answer
Delete migrations django and start over deployment heroku
Python
11 votes145 views4 answers
Add conda env to jupyter
Python
12 votes134 views2 answers
Get random float in range python
Python
-1 vote86 views1 answer
For enumerate start from 1 python
Python