I am a big data team lead at Nielsen.
My team builds massive data pipelines that are cost effective and scalable (~250 Billion events/day). Our projects run on AWS, using Kafka, Spark, serverless Lambda functions, Airflow, OpenFAAS, Kubernetes and more.
I am passionate about new technologies, data, algorithms and machine learning. I love to tackle difficult problems and come up with amazing solutions to them.
I have 4 patents in the area of security, and lots of ideas for more..
Sessions
- Scale16.06.2021 18:10 – 18:40KesselhausIntermediate
Should you consume Kafka in a stream OR batch? When should you choose each one? What is more efficient, and cost effective? Should you even care?
In this talk we’ll give you the tools and metrics to decide which solution you should apply when, and show you a real life example with cost…