Kafka subscription or in simple terms subscribing from Kafka topic is quite tricky. There are some concepts that are important to know if you are implementing this solution and especially when you are managing Kafka too :) I have gone through a number of articles but I haven't seen any clean implementation or neither folks have discussed the same, making it extremely difficult for a novice to do the implementation.

Although this article is only to discuss how to subscribe from a Kafka topic using Python implementation, however, I would recommend going through my previous article that discusses connecting Kafka…


This is going to be very interesting for folks who are interested to connect Kafka directly to the Elastic Search. As the architecture team in the organization, we wanted to bring agility and robustness to how we ingest data today. We are totally dependent on AWS services at this moment and one of the many reasons is that we did not want to have a high dependency on one cloud provider and wanted a solution to be portable.

After long deliberation, I thought of doing the proof-of-concept on ingesting data from Kafka to elastic search. However, I got into a…


Tengo un amigo que está trabajando con IA Conversacional y me habló desde un principio de RASA. Inicialmente, era escéptico acerca de su rendimiento, la facilidad de desarrollo, la simplicidad, etc., pero me ha demostrado que estaba equivocado cuando intentaba cuestionarlo. Con esta herramienta, he podido crear mi primer bot en poco tiempo y, en consecuencia, desde entonces he estado enamorado de RASA. De hecho, he llevado a cabo un par de grandes proyectos con esta plataforma. Esto se traduce en que durante el último año he visto crecer esta herramienta. …


My friend who had learnt about conversational AI told me about RASA stack. Initially I was sceptical about its performance, developer friendliness, simplicity etc however it has proven me wrong at each step whenever I tried to question it. I could create my first bot in no time and since then I have been in love with RASA. I have done couple of large projects with it. This essentially means that I have seen this thing growing over the past one year. …

Soumya Mukherjee

Thought Leader | Test Engineering | DevTestOps | Cognitive Test Automation | Data Scientist | Conversational AI | Chatbot Developer | Growth Hacker |

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store