How to process 500,000 events per second with Kafka

How to process 500,000 events per second with Kafka

About The Webinar

Coralogix ingests tens of billions of messages per day. Every one of these records needs to go through our entire pipeline at near real-time rates. Validation, parsing, classification, and ingestion to Elasticsearch. How do we process all of this data, so quickly?

We had to rethink our entire approach to message processing from the ground up. Leveraging Kafka as our message broker, we learned some powerful techniques for high-performance message ingestion.

In this webinar, we’ll detail our entire journey. From tuning the JVM, through to architectural principles - we’ll cover it all.

Hosted by:
Chris Cooney, Senior Cloud Developer

Guest Speaker:
Yoni Farin, CTO at Coralogix

Former R&D group leader at Verint Ltd. Over 15 years of experience in software development, team, and group leadership. Specializing in big data and distributed systems.

Yoni Farin

Co-Founder and CTO at Coralogix

Watch the Webinar Now

Webinar Hosted by Chris Cooney with Guest Speaker Yoni Farin

You will also be sent an email with the webinar recording + slides

Chris has worked as a senior software engineer across multiple industries, and has focused primarily on cloud infrastructure, monitoring, reliability & scalability.

Chris Cooney

Senior Cloud Engineer, Sainsbury's Digital, Tech and Data

On-Demand Webinar