Skip to content Skip to sidebar Skip to footer
Showing posts with the label Apache Kafka

How To Decode/deserialize Avro With Python From Kafka

I am receiving from a remote server Kafka Avro messages in Python (using the consumer of Confluent … Read more How To Decode/deserialize Avro With Python From Kafka

Python Redis Subscribe Can Not Get All Datas?

I am using python to get datas from redis and then parser it to kafka. It works well in most situat… Read more Python Redis Subscribe Can Not Get All Datas?

How To Consume Messages Using Beam's External Kafka Transform (locally)

I am trying to run an app that uses a kafka producer (Python client), and an apache beam pipeline t… Read more How To Consume Messages Using Beam's External Kafka Transform (locally)

No Module Named 'pyspark.streaming.kafka' Even With Older Spark Version

In another similar question, they hint 'install older spark 2.4.5.' EDIT: the solution from… Read more No Module Named 'pyspark.streaming.kafka' Even With Older Spark Version

Apache Flink: Kafka Connector In Python Streaming Api, "cannot Load User Class"

I am trying out Flink's new Python streaming API and attempting to run my script with ./flink-1… Read more Apache Flink: Kafka Connector In Python Streaming Api, "cannot Load User Class"

Spark Python Avro Kafka Deserialiser

I have created a kafka stream in a python spark app and can parse any text that comes through it. … Read more Spark Python Avro Kafka Deserialiser

Kafka-python Read From Last Produced Message After A Consumer Restart

i am using kafka-python to consume messages from a kafka queue (kafka version 0.10.2.0). In particu… Read more Kafka-python Read From Last Produced Message After A Consumer Restart

How To Connect Python Consumer To AWS MSK

I'm trying to connect my python consumer to AWS MSK cluster. how can I do that? Have an AWS MSK… Read more How To Connect Python Consumer To AWS MSK