Hello 👋, In this article we're going to build a data pipeline that connects Kafka to MongoDB. In short, we're going to add a MongoDB Sink connector to a Kafka Connect cluster and run a MongoDB instance in Docker to test the connector. By reading this article I hope that you will learn How to … Continue reading Kafka Connect MongoDB Sink Connector
Tutorial
Improving the throughput of a Producer ✈
Hello 👋, In this article I will give you some tips on how to improve the throughput of a message producer. I had to write a Golang based application which would consume messages from Apache Kafka and send them into a sink using HTTP JSON / HTTP Protocol Buffers. To see if my idea works, … Continue reading Improving the throughput of a Producer ✈
Sharding MongoDB using Range strategy
Hi 👋👋 In this article I will explore the topic of sharding a Mongo Database that runs on Kubernetes. Before we get started, if you want to follow along, please install the tools listed in the prerequisites section, and if you want to learn more about sharding, check out this fantastic article Sharding Pattern. Prerequisites … Continue reading Sharding MongoDB using Range strategy
Kubernetes service account for pod
Hi 🙋♂️, In this article I will talk about how to authenticate your applications to the Kubernetes API via the service accounts feature. Citing the Kubernetes docs, a service account for a pod: "provides an identity for processes that run in a Pod. When you (a human) access the cluster (for example, using kubectl), you … Continue reading Kubernetes service account for pod
