/Python/Kafka get last offset of topic python

Kafka get last offset of topic python

from kafka import SimpleClient
from kafka.protocol.offset import OffsetRequest, OffsetResetStrategy
from kafka.common import OffsetRequestPayload

client = SimpleClient(brokers)

partitions = client.topic_partitions[topic]
offset_requests = [OffsetRequestPayload(topic, p, -1, 1) for p in partitions.keys()]

offsets_responses = client.send_offset_request(offset_requests)

for r in offsets_responses:
    print "partition = %s, offset = %s"%(r.partition, r.offsets[0])

Source: stackoverflow.com

Similar codes

0 vote148 views2 answers
Django admin image
Python Django
2 votes101 views1 answer
Pandas transform
Python
2 votes112 views1 answer
Python b before string
Python
0 vote108 views1 answer
Mean bias error
Python
0 vote108 views1 answer
How to make a nan value in a list
Python
0 vote105 views1 answer
Getting python class from string
Python
-1 vote99 views1 answer
Numpy apply function to array
Python
0 vote148 views1 answer
Gpt2 simple restore_from
Python
11 votes136 views6 answers
Pandas join dataframe
Python
0 vote84 views1 answer
Python - exchange rate API
Python