/Python/Kafka get last offset of topic python

Kafka get last offset of topic python

from kafka import SimpleClient
from kafka.protocol.offset import OffsetRequest, OffsetResetStrategy
from kafka.common import OffsetRequestPayload

client = SimpleClient(brokers)

partitions = client.topic_partitions[topic]
offset_requests = [OffsetRequestPayload(topic, p, -1, 1) for p in partitions.keys()]

offsets_responses = client.send_offset_request(offset_requests)

for r in offsets_responses:
    print "partition = %s, offset = %s"%(r.partition, r.offsets[0])

Source: stackoverflow.com

Similar codes

0 vote169 views1 answer
Pyqt5.direct connection
Python
0 vote196 views1 answer
Autofield in django
Python
0 vote166 views1 answer
Quantile-quantile plot python
Python
2 votes157 views1 answer
Python get all characters
Python
0 vote178 views1 answer
Python how to d oa hello worl
Python
0 vote148 views1 answer
Pandas dataframe display cell size
Python
9 votes202 views2 answers
Django app
Python Django
0 vote110 views1 answer
Savefig image size
Python
0 vote149 views1 answer
Get all view port type dynamo revit
Python
0 vote149 views1 answer
Rename pandas columns with list of new names
Python