EuropeClouds Summit 2021 -Apache Kafka and Flink: Stateful Streaming Data Pipelines made easy with SQL

MarkeTech

April 27, 2022

EuropeClouds Summit 2021

Apache Kafka and Flink: Stateful Streaming Data Pipelines made easy with SQL

A stateful streaming data pipeline needs both a solid base and an engine to drive the data. Apache Kafka is an excellent choice for storing and transmitting high throughput and low latency messages. Apache Flink adds the cherry on top with a distributed stateful compute engine available in a variety of languages, including SQL.

In this session we'll explore how Apache Flink operates in conjunction with Apache Kafka to build stateful streaming data pipelines, and the problems we can solve with this combination. We will explore Flink's SQL client, showing how to define connections and transformations with the most known and beloved language in the data industry.
This session is aimed at data professionals who want to reduce the barrier to streaming data pipelines by making them configurable as a set of simple SQL commands.

Francesco Tisiot

MarkeTech é uma companhia de mídia que acredita em conteúdo, conteúdo real que dá valor aos seus membros.

Nós criamos podcasts, vlogs e artigos baseados em nossas comunidades globais.

‍

Related Posts

EuropeClouds Summit 2021 - Blockchain Security: Privacy Protection At Blockchain Technology

We will review the Key Technologies Of Privacy Protection like Zero Knowledge Proof, Homomorphic Encryption, sMPC - Secure Multi-Party Computation.

EuropeClouds Team

EuropeClouds Summit 2021 -Gareth McCumskey- Event Driven Serverless Microservices

A very compelling, resilient and scalable way to build modern applications. Combining the powering of Serverless and Microservices in a way that makes you feel like a superhero while simultaneously saving money and getting results out faster for your customers. Isn't that what we all want?

EuropeClouds Summit 2021 -Liana Ziskind- Data Migration from one cloud provider to another

We will show the difference between the two approaches, the pros and cons of using each. Then we will dive into the native data clouds. Comparison of main features between the most popular data cloud providers will give you tools for better decision-making on the cloud platform that best fits your organization.

EuropeClouds Summit 2021 -Tejas Chopra Compression, Deduplication & Encryption in Cloud

We will cover some strategies for employing these techniques depending on whether an organization prefers client side or server side encryption, and discuss online and offline deduplication of objects.

EuropeClouds Summit 2021 -How to Improve Software Architecture Skills Daily

You are joining a meeting where someone presents a design review for a big new feature. You point out that something is a bad idea and they ask you why. The whole room is now looking at you and you just say "I JUST KNOW it's not going to work", but you don't know how you know.

EuropeClouds Summit 2021 -Serverless computing with Google Cloud, Wesley Chun, Google Cloud

App modernization is all about taking on-prem apps, getting them containerized, running on VMs, perhaps orchestrating with Kubernetes, and eventually into the cloud. Once you're far enough down this path, you'll come across "serverless."

EuropeClouds Summit 2021 -Integration Architecture at Allianz, Dr. Annegret Junker

Integration architectures play a key role in modern cloud architecture. Those are highly complex. Moreover, one must be aware that they are changing constantly It is necessary to react on those changes with a flexible integration architecture without jeopardizing the entire system.

EuropeClouds Summit 2021 -Accelerating Application Modernization and Cloud Migration with Redis, Allen Terleto, Redis

These digital transformations promised increased business agility, many stagnated due to limitations with legacy technology and a reluctance to migrate mission-critical applications to the cloud

Newsletter BrazilClouds.com

Thank you! Your submission has been received!

Oops! Something went wrong while submitting the form