Ido Nadler
Senior Big Data Engineer
Ido Nadler

I am a senior big data developer at Nielsen. 
My work focuses on building massive data pipelines (~250 Billion events/day) and infrastructure for running machine learning algorithms.
My projects run on AWS using a variety of technologies like Kafka, Spark, Airflow, Kubernetes and more.
I like to continuously experiment with new technologies, tackle challenging problems, and find those better, more elegant and cost effective solutions.

Sessions

  • Scale
    16.06.2021 18:10 – 18:40
    Kesselhaus
    Intermediate

    Should you consume Kafka in a stream OR batch? When should you choose each one? What is more efficient, and cost effective? Should you even care?

    In this talk we’ll give you the tools and metrics to decide which solution you should apply when, and show you a real…