/Python/Kafka get last offset of topic python

Kafka get last offset of topic python

from kafka import SimpleClient
from kafka.protocol.offset import OffsetRequest, OffsetResetStrategy
from kafka.common import OffsetRequestPayload

client = SimpleClient(brokers)

partitions = client.topic_partitions[topic]
offset_requests = [OffsetRequestPayload(topic, p, -1, 1) for p in partitions.keys()]

offsets_responses = client.send_offset_request(offset_requests)

for r in offsets_responses:
    print "partition = %s, offset = %s"%(r.partition, r.offsets[0])

Source: stackoverflow.com

Similar codes

12 votes139 views2 answers
Get python version jupyter
Python
0 vote133 views1 answer
Python press key to break
Python
1 vote134 views1 answer
No such table: django_session admin
Python
0 vote130 views1 answer
How to replace first line of a textfile python
Python
0 vote136 views1 answer
Python sort array custom comparator
Python
1 vote155 views1 answer
How to print the text of varying length in python
Python
0 vote150 views1 answer
Cmake python interpreter
Python
2 votes136 views1 answer
Selenium zoom out python
Python
3 votes179 views4 answers
Django setup in windows
Python Django
0 vote136 views1 answer
Cursor.fetchall() to list
Python