Hello 👋, In this article we're going to build a data pipeline that connects Kafka to MongoDB. In short, we're going to add a MongoDB Sink connector to a Kafka Connect cluster and run a MongoDB instance in Docker to test the connector. By reading this article I hope that you will learn How to … Continue reading Kafka Connect MongoDB Sink Connector
kafka
Improving the throughput of a Producer ✈
Hello 👋, In this article I will give you some tips on how to improve the throughput of a message producer. I had to write a Golang based application which would consume messages from Apache Kafka and send them into a sink using HTTP JSON / HTTP Protocol Buffers. To see if my idea works, … Continue reading Improving the throughput of a Producer ✈
Kafka Connect GitHub source connector
Hello! In this article we will discuss how to quickly get started with Kafka and Kafka Connect to grab all the commits from a Github repository. This is a practical tutorial which saves you some time browsing the Kafka's documentation. Environment Kafka is bit difficult to setup, you will need Kafka, Zookeper and Kafka Connect … Continue reading Kafka Connect GitHub source connector
