Towards A Stream Centered Enterprise, Gabriel Commeau

•Download as PPTX, PDF•

1 like•1,196 views

In this talk, you’ll learn how we’re taking Comcast’s Technology and Product group’s massive, heterogeneous set of data collection systems and centralizing on a single platform built around Kafka. These data collection systems are used for everything from business analytics, to near-real time operations, to executive reporting. We’ll go over what it takes to wrangle streaming data across an enterprise, including the need for, and our approaches to: Schema management, both at schema creation time and when schema evolution is required Data ingest and cleansing Multi-datacenter collection and failover How we use the same data stream for many different purposes, across many different teams

Towards a Stream-Centered Enterprise
Kafka Summit 2016
Gabriel Commeau

o Avro versus json, protobuf, xml, thrift
o Some guidelines for Avro schema:
• Document it all
• Use explicit names
• Provide default value
• Avoid complex union type
• If possible avoid byte arrays
o Use:
• Common core schemas
• Proper nesting
• Enum + String
Schema Management

Avro Schema Evolution
Enum
• Reader can add value
• Writer can remove value
Don’t
• Change namespace
• Change name
• Unless default value
• Change type
Do
• Use default value
• Use union type
containing null
Union Type
• Change type order ok
• Reader can add type
• Writer can remove type
Compatibility
Ok
• Change order
• Change, add, remove,
reorder alias

With 60+ products and over 24% of the US GDP flowing through it, system integration is a tough problem for Intuit. Seasonality, scale, and massive peaks in products like TurboTax, QuickBooks, and Mint.com add extra layers of difficulty when building shared data services around transaction and user graphs, clickstream processing, a/b testing, and personalization. To reduce complexity and latency, we’ve implemented Kafka as the backbone across these data services. This allows us to asynchronously trigger relevant processing, elegantly scaling up and down as needed around peaks, all without the need for point-to-point integrations. In this talk, we share what we’ve learned about Kafka at Intuit and describe our data services architecture. We found that Kafka is invaluable in achieving a scalable, clean architecture, allowing engineering teams to focus less on integration and more on product development.

Never at Rest - IoT and Data Streaming at British Gas Connected Homes, Paul M...

confluent

Connected Homes is at the forefront of IoT in the UK. Spun out of British Gas in 2012, its expanding Hive IoT product range & its access to the largest pool of UK smart meter data uniquely positions it as a key player in the UK market. We will share with you how Apache Kafka has become a strategic technology used throughout the business and explore some of our use cases. We will give a brief overview of Connected Homes and why Apache Kafka is being adopted in teams for operational, feature and realtime data science purposes. Deeper technical insights will be shown around smart meter customers and how we use Apache Kafka to provide realtime alerting.

Kafka, the "DialTone for Data": Building a self-service, scalable, streaming ...

confluent

Kafka is used as a "dial tone for data" to ingest large amounts of data at HomeAway. An experiment using Kafka and Camus to ingest over 1TB of data per day from various systems and applications was successful. It allowed for various use cases like SLA reporting, fraud detection, search and clickstream analysis, and traveler segmentation. Key lessons included the importance of the schema registry for decoupling producers and consumers, and making stream processing easy through tools like Samza. The presentation concludes that Kafka allows building systems of engagement and intelligence on top of ingested data.

Introducing Kafka Streams: Large-scale Stream Processing with Kafka, Neha Nar...

confluent

The concept of stream processing has been around for a while and most software systems continuously transform streams of inputs into streams of outputs. Yet the idea of directly modeling stream processing in infrastructure systems is just coming into its own after a few decades on the periphery. At its core, stream processing is simple: read data in, process it, and maybe emit some data out. So why are there so many stream processing frameworks that all define their own terminology? And are the components of each even comparable? Why do I need to know about spouts or DStreams just to process a simple sequence of records? Depending on your application’s requirements, you may not need a framework. This talk will be delivered by one of the creators of the popular stream data systems Apache Kafka and will abstract away the details of individual frameworks while describing the key features they provide. These core features include scalability and parallelism through data partitioning, fault tolerance and event processing order guarantees, support for stateful stream processing, and handy stream processing primitives such as windowing. Based on our experience building and scaling Kafka to handle streams that captured hundreds of billions of records per day — this presentation will help you understand how to map practical data problems to stream processing and how to write applications that process streams of data at scale.

Securing Kafka

confluent

Kafka Connect: Real-time Data Integration at Scale with Apache Kafka, Ewen Ch...

confluent

Many companies are adopting Apache Kafka to power their data pipelines, including LinkedIn, Netflix, and Airbnb. Kafka’s ability to handle high throughput real-time data makes it a perfect fit for solving the data integration problem, acting as the common buffer for all your data and bridging the gap between streaming and batch systems. However, building a data pipeline around Kafka today can be challenging because it requires combining a wide variety of tools to collect data from disparate data systems. One tool streams updates from your database to Kafka, another imports logs, and yet another exports to HDFS. As a result, building a data pipeline can take significant engineering effort and has high operational overhead because all these different tools require ongoing monitoring and maintenance. Additionally, some of the tools are simply a poor fit for the job: the fragmented nature of the data integration tools ecosystem lead to creative but misguided solutions such as misusing stream processing frameworks for data integration purposes. We describe the design and implementation of Kafka Connect, Kafka’s new tool for scalable, fault-tolerant data import and export. First we’ll discuss some existing tools in the space and why they fall short when applied to data integration at large scale. Next, we will explore Kafka Connect’s design and how it compares to systems with similar goals, discussing key design decisions that trade off between ease of use for connector developers, operational complexity, and reuse of existing connectors. Finally, we’ll discuss how standardizing on Kafka Connect can ultimately lead to simplifying your entire data pipeline, making ETL into your data warehouse and enabling stream processing applications as simple as adding another Kafka connector. eventbrite_kafka_summit_event_logo_v3-035858-edited.png

Simplifying Event Streaming: Tools for Location Transparency and Data Evoluti...

confluent

At Under Armour Connected Fitness, we’ve built an event streaming platform on top of Kafka and the Confluent stack that makes it easy for developers to produce and consume schema-based events without requiring direct knowledge of Kafka. We are constantly trying to improve the developer experience. The platform consists of multiple federated Kafka clusters, a schema registry, a topology service, an archiver and specialized client libraries and Web / CLI tools that assist developers with producer and consumer workflows. In this talk, we will take a deeper dive into the design and implementation of a Scala/Java implementation of our client library that allows developers to produce or consume events without worrying about the underlying infrastructure and their location while enjoying the benefits of data compatibility through schemas. We’ll also look at an HTTP based client proxy that exposes the same API but for languages without our native support. Finally, we’ll walk through Web and CLI tools we built to make working with the platform easier. The content of this talk will be primarily aimed at software developers looking for ideas on how to build Kafka client tools that allow producer/consumer interactions protected by schema-based event definitions while hiding details of the underlying infrastructure.

This document discusses using Apache Kafka for database replication in LinkedIn's ESPRESSO database system. It provides an overview of ESPRESSO's architecture and transition from per-instance to per-partition replication using Kafka. Key aspects covered include Kafka configuration, the message protocol for ensuring in-order delivery, and checkpointing by the Kafka producer to allow resuming replication from the last committed transaction after failures.

When it Absolutely, Positively, Has to be There: Reliability Guarantees in Ka...

confluent

In the financial industry, losing data is unacceptable. Financial firms are adopting Kafka for their critical applications. Kafka provides the low latency, high throughput, high availability, and scale that these applications require. But can it also provide complete reliability? As a system architect, when asked “Can you guarantee that we will always get every transaction,” you want to be able to say “Yes” with total confidence. In this session, we will go over everything that happens to a message – from producer to consumer, and pinpoint all the places where data can be lost – if you are not careful. You will learn how developers and operation teams can work together to build a bulletproof data pipeline with Kafka. And if you need proof that you built a reliable system – we’ll show you how you can build the system to prove this too.

Clickstream Analysis with Apache Spark

QAware GmbH

Apache Big Data Conference 2016, Vancouver BC: Talk by Andreas Zitzelsberger (@andreasz82, Principal Software Architect at QAware) Abstract: On large-scale web sites, users leave thousands of traces every second. Businesses need to process and interpret these traces in real-time to be able to react to the behavior of their users. In this talk, Andreas shows a real world example of the power of a modern open-source stack. He will walk you through the design of a real-time clickstream analysis PAAS solution based on Apache Spark, Kafka, Parquet and HDFS. Andreas explains our decision making and presents our lessons learned.

Building an Event-oriented Data Platform with Kafka, Eric Sammer

confluent

While we frequently talk about how to build interesting products on top of machine and event data, the reality is that collecting, organizing, providing access to, and managing this data is where most people get stuck. Many organizations understand the use cases around their data – fraud detection, quality of service and technical operations, user behavior analysis, for example – but are not necessarily data infrastructure experts. In this session, we’ll follow the flow of data through an end to end system built to handle tens of terabytes an hour of event-oriented data, providing real time streaming, in-memory, SQL, and batch access to this data. We’ll go into detail on how open source systems such as Hadoop, Kafka, Solr, and Impala/Hive are actually stitched together; describe how and where to perform data transformation and aggregation; provide a simple and pragmatic way of managing event metadata; and talk about how applications built on top of this platform get access to data and extend its functionality. Attendees will leave this session knowing not just which open source projects go into a system such as this, but how they work together, what tradeoffs and decisions need to be addressed, and how to present a single general purpose data platform to multiple applications. This session should be attended by data infrastructure engineers and architects planning, building, or maintaining similar systems.

Building Large-Scale Stream Infrastructures Across Multiple Data Centers with...

confluent

BY Jun Rao From the Bay Area Apache Kafka September 2016 Meetup. Abstract: To manage the ever-increasing volume and velocity of data within your company you have successfully made the transition from single machines and one-off solutions to large, distributed stream infrastructures in your data center powered by Apache Kafka. But what needs to be done if one data center is not enough? In this session we describe building resilient data pipelines with Apache Kafka that span multiple data centers and points of presence. We provide an overview of best practices and common patterns while covering key areas such as architecture guidelines, data replication and mirroring as well as disaster scenarios and failure handling.

A Practical Guide to Selecting a Stream Processing Technology

confluent

Presented by Michael Noll, Product Manager, Confluent. Why are there so many stream processing frameworks that each define their own terminology? Are the components of each comparable? Why do you need to know about spouts or DStreams just to process a simple sequence of records? Depending on your application’s requirements, you may not need a full framework at all. Processing and understanding your data to create business value is the ultimate goal of a stream data platform. In this talk we will survey the stream processing landscape, the dimensions along which to evaluate stream processing technologies, and how they integrate with Apache Kafka. Particularly, we will learn how Kafka Streams, the built-in stream processing engine of Apache Kafka, compares to other stream processing systems that require a separate processing infrastructure.

Siphon - Near Real Time Databus Using Kafka, Eric Boyd, Nitin Kumar

confluent

Siphon is a highly available and reliable distributed pub/sub system built using Apache Kafka. It is used to publish, discover and subscribe to near real-time data streams for operational and product intelligence. Siphon is used as a “Databus” by a variety of producers and subscribers in Microsoft, and is compliant with security and privacy requirements. It has a built-in Auditing and Quality control. This session will provide an overview of the use of Kafka at Microsoft, and then deep dive into Siphon. We will describe an important business scenario and talk about the technical details of the system in the context of that scenario. We will also cover the design and implementation of the service, the scale, and real world production experiences from operating the service in the Microsoft cloud environment.

Deploying Kafka at Dropbox, Mark Smith, Sean Fellows

confluent

At Dropbox we are currently handling approximately 10,000,000 messages per second at peak across our handful of Kafka clusters. The largest of which has hit throughputs of 7,000,000 per second (~30 Gbps) on only 20 nodes. We’ll walk you through the steps we took to get where we are, the design that works for us — and those that didn’t. We’ll talk about the tooling we had to build and what we want to see exist. We’ll dive deeper into configuration and provide a blueprint you can follow. We’ll talk about the trials and tribulations of using Kafka — including ways we’ve set our clusters on fire, ways we’ve lost data, ways we’ve turned our hairs gray, and ways we’ve heroically saved the day for our users. Finally, we’ll spend time on some of the work we’re doing to handle consumer coordination across our many different systems and to integrate Kafka into a well established corporate infrastructure. (I.e., making Kafka “”play nice”” with everybody.)

The Rise of Real Time

confluent

Near-realtime analytics with Kafka and HBase

dave_revell

Kafka and Stream Processing, Taking Analytics Real-time, Mike Spicer

confluent

Stream processing analyzes data in motion before it is stored, allowing for real-time analytics with low latency. Kafka is well-suited for stream processing due to its speed, scalability, durability, and ability to act as a universal hub. Real-time analytics can handle many use cases like customer intelligence, IoT, and security. Examples include a telco using stream processing for real-time advertising and Thompson Reuters using it for news ingestion and analytics. Stream processing can analyze data from the edge to the center in real-time to detect and predict insights and enable immediate actions.

Advanced Streaming Analytics with Apache Flink and Apache Kafka, Stephan Ewen

confluent

Flink and Kafka are popular components to build an open source stream processing infrastructure. We present how Flink integrates with Kafka to provide a platform with a unique feature set that matches the challenging requirements of advanced stream processing applications. In particular, we will dive into the following points: Flink’s support for event-time processing, how it handles out-of-order streams, and how it can perform analytics on historical and real-time streams served from Kafka’s persistent log using the same code. We present Flink’s windowing mechanism that supports time-, count- and session- based windows, and intermixing event and processing time semantics in one program. How Flink’s checkpointing mechanism integrates with Kafka for fault-tolerance, for consistent stateful applications with exactly-once semantics. We will discuss “”Savepoints””, which allows users to save the state of the streaming program at any point in time. Together with a durable event log like Kafka, savepoints allow users to pause/resume streaming programs, go back to prior states, or switch to different versions of the program, while preserving exactly-once semantics. We explain the techniques behind the combination of low-latency and high throughput streaming, and how latency/throughput trade-off can configured. We will give an outlook on current developments for streaming analytics, such as streaming SQL and complex event processing.

Real-Time Analytics Visualized w/ Kafka + Streamliner + MemSQL + ZoomData, An...

confluent

The document summarizes a presentation about using Kafka, Streamliner, MemSQL and ZoomData for real-time analytics visualization. It shows an initial setup with one producer and queue feeding into Kafka, then adding a sink to an in-memory SQL database and real-time visualization consumer. It asks questions about ensuring the system is resilient, handles bad data and schema evolution, maintains consistency across visualization layers, and ability to scale throughput, concurrency and size.

Stream Processing with Kafka in Uber, Danny Yuan

confluent

- The document discusses Uber's use of stream processing to enable real-time analytics and complex event processing over streaming data from its global ridesharing marketplace. - Key applications include real-time OLAP, detecting patterns in event streams, and supply positioning to monitor marketplace health. - The architecture uses Apache Kafka for event collection, Apache Samza for event processing, and storage and visualization applications. It addresses challenges of processing large-scale, real-time geo-temporal data streams.

Demystifying Stream Processing with Apache Kafka

confluent

www.confluent.io/online-talks/ This talk will introduce Kafka Streams and help you understand how to map practical data problems to stream processing and how to write applications that process streams of data at scale using Kafka Streams. We will also cover what is stream processing, why one should care about stream processing, where Apache Kafka and Kafka Streams fit in, the hard parts of stream processing, and how Kafka Streams solves those problems; along with a concrete example of how these ideas tie together in Kafka Streams and in the big picture of your data center.

Protecting your data at rest with Apache Kafka by Confluent and Vormetric

confluent

This document discusses securing Apache Kafka deployments with Vormetric and Confluent Platform. It begins with an introduction to Apache Kafka and Confluent Platform. It then provides an overview of Vormetric's policy-driven security solution and how it can be used to encrypt Kafka data at rest. The document outlines the typical Confluent Platform deployment architecture and various security considerations, such as authentication, authorization, and data encryption. Finally, it provides steps for implementing secure deployments using SSL, Kerberos, and Vormetric encryption policies.

Streaming SQL

Julian Hyde

Streaming is necessary to handle data rates and latency but SQL is unquestionably the lingua franca of data. Where do the two meet? Apache Calcite is extending SQL to include streaming, and the Samza, Storm and Flink are projects are each building it into their engines. In this talk, Julian Hyde describes streaming SQL in detail and shows how you can use streaming SQL in your application. He also describes how Calcite’s planner optimizes queries for throughput and latency. Julian Hyde gave this talk at the first Kafka Summit, San Francisco, 2016/04/26.

Fundamentals of Stream Processing with Apache Beam, Tyler Akidau, Frances Perry

confluent

Apache Beam (unified Batch and strEAM processing!) is a new Apache incubator project. Originally based on years of experience developing Big Data infrastructure within Google (such as MapReduce, FlumeJava, and MillWheel), it has now been donated to the OSS community at large. Come learn about the fundamentals of out-of-order stream processing, and how Beam’s powerful tools for reasoning about time greatly simplify this complex task. Beam provides a model that allows developers to focus on the four important questions that must be answered by any stream processing pipeline: What results are being calculated? Where in event time are they calculated? When in processing time are they materialized? How do refinements of results relate? Furthermore, by cleanly separating these questions from runtime characteristics, Beam programs become portable across multiple runtime environments, both proprietary (e.g., Google Cloud Dataflow) and open-source (e.g., Flink, Spark, et al).

Kafka + Uber- The World’s Realtime Transit Infrastructure, Aaron Schildkrout

confluent

Kafka is Uber's real-time data infrastructure that powers many of its core systems and products. It processes both real-time and batch data from many different sources and consumers across Uber's distributed systems. Over time, Uber has improved Kafka to handle larger volumes of data across more data centers and languages. Looking forward, Uber envisions Kafka enabling even more dynamic and real-time systems through continued innovation.

More Datacenters, More Problems

Todd Palino

Presented at Kafka Summit 2016 Operating out of multiple datacenters is a large part of most disaster recovery plans, but it brings extra complications to our data pipelines. Instead of having a straight path from front to back, it now has forks and dead ends and odd little use cases that don’t match up with a perfect view of the world. This talk will focus on how to best utilize Apache Kafka in this world, including basic architectures for multi-datacenter and multi-tier clusters. We will also touch on how to assure messages make it from producer to consumer, and how to monitor the entire ecosystem.

Building API data products on top of your real-time data infrastructure

confluent

This talk and live demonstration will examine how Confluent and Gravitee.io integrate to unlock value from streaming data through API products. You will learn how data owners and API providers can document, secure data products on top of Confluent brokers, including schema validation, topic routing and message filtering. You will also see how data and API consumers can discover and subscribe to products in a developer portal, as well as how they can integrate with Confluent topics through protocols like REST, Websockets, Server-sent Events and Webhooks. Whether you want to monetize your real-time data, enable new integrations with partners, or provide self-service access to topics through various protocols, this webinar is for you!

Speed Wins: From Kafka to APIs in Minutes

confluent

Viewers also liked

Espresso Database Replication with Kafka, Tom Quiggle

confluent

When it Absolutely, Positively, Has to be There: Reliability Guarantees in Ka...

confluent

Clickstream Analysis with Apache Spark

QAware GmbH

Building an Event-oriented Data Platform with Kafka, Eric Sammer

confluent

Building Large-Scale Stream Infrastructures Across Multiple Data Centers with...

confluent

A Practical Guide to Selecting a Stream Processing Technology

confluent

Siphon - Near Real Time Databus Using Kafka, Eric Boyd, Nitin Kumar

confluent

Deploying Kafka at Dropbox, Mark Smith, Sean Fellows

confluent

The Rise of Real Time

confluent

Near-realtime analytics with Kafka and HBase

dave_revell

Kafka and Stream Processing, Taking Analytics Real-time, Mike Spicer

confluent

Advanced Streaming Analytics with Apache Flink and Apache Kafka, Stephan Ewen

confluent

Real-Time Analytics Visualized w/ Kafka + Streamliner + MemSQL + ZoomData, An...

confluent

Stream Processing with Kafka in Uber, Danny Yuan

confluent

Demystifying Stream Processing with Apache Kafka

confluent

Protecting your data at rest with Apache Kafka by Confluent and Vormetric

confluent

Streaming SQL

Julian Hyde

Fundamentals of Stream Processing with Apache Beam, Tyler Akidau, Frances Perry

confluent

Kafka + Uber- The World’s Realtime Transit Infrastructure, Aaron Schildkrout

confluent

More Datacenters, More Problems

Todd Palino

Viewers also liked (20)

Espresso Database Replication with Kafka, Tom Quiggle

When it Absolutely, Positively, Has to be There: Reliability Guarantees in Ka...

Clickstream Analysis with Apache Spark

Building an Event-oriented Data Platform with Kafka, Eric Sammer

Building Large-Scale Stream Infrastructures Across Multiple Data Centers with...

A Practical Guide to Selecting a Stream Processing Technology

Siphon - Near Real Time Databus Using Kafka, Eric Boyd, Nitin Kumar

Deploying Kafka at Dropbox, Mark Smith, Sean Fellows

The Rise of Real Time

Near-realtime analytics with Kafka and HBase

Kafka and Stream Processing, Taking Analytics Real-time, Mike Spicer

Advanced Streaming Analytics with Apache Flink and Apache Kafka, Stephan Ewen

Real-Time Analytics Visualized w/ Kafka + Streamliner + MemSQL + ZoomData, An...

Stream Processing with Kafka in Uber, Danny Yuan

Demystifying Stream Processing with Apache Kafka

Protecting your data at rest with Apache Kafka by Confluent and Vormetric

Streaming SQL

Fundamentals of Stream Processing with Apache Beam, Tyler Akidau, Frances Perry

Kafka + Uber- The World’s Realtime Transit Infrastructure, Aaron Schildkrout

More Datacenters, More Problems

More from confluent

Building API data products on top of your real-time data infrastructure

confluent

Speed Wins: From Kafka to APIs in Minutes

confluent

Evolving Data Governance for the Real-time Streaming and AI Era

confluent

Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...

confluent

Santander Stream Processing with Apache Flink

confluent

Unlocking the Power of IoT: A comprehensive approach to real-time insights

confluent

Workshop híbrido: Stream Processing con Flink

confluent

El Stream processing es un requisito previo de la pila de data streaming, que impulsa aplicaciones y pipelines en tiempo real. Permite una mayor portabilidad de datos, una utilización optimizada de recursos y una mejor experiencia del cliente al procesar flujos de datos en tiempo real. En nuestro taller práctico híbrido, aprenderás cómo filtrar, unir y enriquecer fácilmente datos en tiempo real dentro de Confluent Cloud utilizando nuestro servicio Flink sin servidor.

Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...

confluent

Our talk will explore the transformative impact of integrating Confluent, HiveMQ, and SparkPlug in Industry 4.0, emphasizing the creation of a Unified Namespace. In addition to the creation of a Unified Namespace, our webinar will also delve into Stream Governance and Scaling, highlighting how these aspects are crucial for managing complex data flows and ensuring robust, scalable IIoT-Platforms. You will learn how to ensure data accuracy and reliability, expand your data processing capabilities, and optimize your data management processes. Don't miss out on this opportunity to learn from industry experts and take your business to the next level.

AWS Immersion Day Mapfre - Confluent

confluent

La arquitectura impulsada por eventos (EDA) será el corazón del ecosistema de MAPFRE. Para seguir siendo competitivas, las empresas de hoy dependen cada vez más del análisis de datos en tiempo real, lo que les permite obtener información y tiempos de respuesta más rápidos. Los negocios con datos en tiempo real consisten en tomar conciencia de la situación, detectar y responder a lo que está sucediendo en el mundo ahora.

Eventos y Microservicios - Santander TechTalk

confluent

Q&A with Confluent Experts: Navigating Networking in Confluent Cloud

confluent

This document discusses networking options and best practices for Confluent Cloud. It provides an overview of public endpoints, private link, and peering options. It then discusses best practices for private networking architectures on Azure using hub-and-spoke and private link designs. Finally, it addresses networking considerations and challenges for Kafka Connect managed connectors, as well as planned enhancements for DNS peering and outbound private link support.

Citi TechTalk Session 2: Kafka Deep Dive

confluent

Build real-time streaming data pipelines to AWS with Confluent

confluent

Traditional data pipelines often face scalability issues and challenges related to cost, their monolithic design, and reliance on batch data processing. They also typically operate under the premise that all data needs to be stored in a single centralized data source before it's put to practical use. Confluent Cloud on Amazon Web Services (AWS) provides a fully managed cloud-native platform that helps you simplify the way you build real-time data flows using streaming data pipelines and Apache Kafka.

Q&A with Confluent Professional Services: Confluent Service Mesh

confluent

Citi Tech Talk: Event Driven Kafka Microservices

confluent

Confluent & GSI Webinars series - Session 3

confluent

An in depth look at how Confluent is being used in the financial services industry. Gain an understanding of how organisations are utilising data in motion to solve common problems and gain benefits from their real time data capabilities. It will look more deeply into some specific use cases and show how Confluent technology is used to manage costs and mitigate risks. This session is aimed at Solutions Architects, Sales Engineers and Pre Sales, and also the more technically minded business aligned people. Whilst this is not a deeply technical session, a level of knowledge around Kafka would be helpful.

Citi Tech Talk: Messaging Modernization

confluent

This document discusses moving to an event-driven architecture using Confluent. It begins by outlining some of the limitations of traditional messaging middleware approaches. Confluent provides benefits like stream processing, persistence, scalability and reliability while avoiding issues like lack of structure, slow consumers, and technical debt. The document then discusses how Confluent can help modernize architectures, enable new real-time use cases, and reduce costs through migration. It provides examples of how companies like Advance Auto Parts and Nord/LB have benefitted from implementing Confluent platforms.

Citi Tech Talk: Data Governance for streaming and real time data

confluent

Confluent & GSI Webinars series: Session 2

confluent

Data In Motion Paris 2023

confluent

Vous apprendrez également à : • Créer plus rapidement des produits et fonctionnalités à l’aide d’une suite complète de connecteurs et d’outils de gestion des flux, et à connecter vos environnements à des pipelines de données • Protéger vos données et charges de travail les plus critiques grâce à des garanties intégrées en matière de sécurité, de gouvernance et de résilience • Déployer Kafka à grande échelle en quelques minutes tout en réduisant les coûts et la charge opérationnelle associés

More from confluent (20)

Building API data products on top of your real-time data infrastructure

Speed Wins: From Kafka to APIs in Minutes

Evolving Data Governance for the Real-time Streaming and AI Era

Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...

Santander Stream Processing with Apache Flink

Unlocking the Power of IoT: A comprehensive approach to real-time insights

Workshop híbrido: Stream Processing con Flink

Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...

AWS Immersion Day Mapfre - Confluent

Eventos y Microservicios - Santander TechTalk

Q&A with Confluent Experts: Navigating Networking in Confluent Cloud

Citi TechTalk Session 2: Kafka Deep Dive

Build real-time streaming data pipelines to AWS with Confluent

Q&A with Confluent Professional Services: Confluent Service Mesh

Citi Tech Talk: Event Driven Kafka Microservices

Confluent & GSI Webinars series - Session 3

Citi Tech Talk: Messaging Modernization

Citi Tech Talk: Data Governance for streaming and real time data

Confluent & GSI Webinars series: Session 2

Data In Motion Paris 2023

Recently uploaded

❣Unsatisfied Bhabhi Call Girls Surat 💯Call Us 🔝 7014168258 🔝💃Independent Sura...

hotchicksescort

❣Independent Call Girls Chennai 💯Call Us 🔝 7737669865 🔝💃Independent Chennai E...

nainakaoornoida

Better Builder Magazine, Issue 49 / Spring 2024

Better Builder Magazine

Literature review for prompt engineering of ChatGPT.pptx

LokerXu2

Call Girls Goa (india) ☎️ +91-7426014248 Goa Call Girl

sapna sharmap11

Call Girls In Lucknow 🔥 +91-7014168258🔥High Profile Call Girl Lucknow

yogita singh$A17

Update 40 models( Solar Cell ) in SPICE PARK(JUL2024)

Tsuyoshi Horigome

Covid Management System Project Report.pdf

Kamal Acharya

CoVID-19 sprang up in Wuhan China in November 2019 and was declared a pandemic by the in January 2020 World Health Organization (WHO). Like the Spanish flu of 1918 that claimed millions of lives, the COVID-19 has caused the demise of thousands with China, Italy, Spain, USA and India having the highest statistics on infection and mortality rates. Regardless of existing sophisticated technologies and medical science, the spread has continued to surge high. With this COVID-19 Management System, organizations can respond virtually to the COVID-19 pandemic and protect, educate and care for citizens in the community in a quick and effective manner. This comprehensive solution not only helps in containing the virus but also proactively empowers both citizens and care providers to minimize the spread of the virus through targeted strategies and education.

Sri Guru Hargobind Ji - Bandi Chor Guru.pdf

Balvir Singh

Sri Guru Hargobind Ji (19 June 1595 - 3 March 1644) is revered as the Sixth Nanak. • On 25 May 1606 Guru Arjan nominated his son Sri Hargobind Ji as his successor. Shortly afterwards, Guru Arjan was arrested, tortured and killed by order of the Mogul Emperor Jahangir. • Guru Hargobind's succession ceremony took place on 24 June 1606. He was barely eleven years old when he became 6th Guru. • As ordered by Guru Arjan Dev Ji, he put on two swords, one indicated his spiritual authority (PIRI) and the other, his temporal authority (MIRI). He thus for the first time initiated military tradition in the Sikh faith to resist religious persecution, protect people’s freedom and independence to practice religion by choice. He transformed Sikhs to be Saints and Soldier. • He had a long tenure as Guru, lasting 37 years, 9 months and 3 days

🔥Young College Call Girls Chandigarh 💯Call Us 🔝 7737669865 🔝💃Independent Chan...

sonamrawat5631

SPICE PARK JUL2024 ( 6,866 SPICE Models )

Tsuyoshi Horigome

High Profile Call Girls Ahmedabad 🔥 7737669865 🔥 Real Fun With Sexual Girl Av...

dABGO KI CITy kUSHINAGAR Ak47

Cuttack Call Girls 💯Call Us 🔝 7374876321 🔝 💃 Independent Female Escort Service

yakranividhrini

AN INTRODUCTION OF AI & SEARCHING TECHIQUES

drshikhapandey2022

🔥Independent Call Girls In Pune 💯Call Us 🔝 7014168258 🔝💃Independent Pune Esco...

AK47

Call Girls Chennai +91-8824825030 Vip Call Girls Chennai

paraasingh12 #V08

Mahipalpur Call Girls Delhi 🔥 9711199012 ❄- Pick Your Dream Call Girls with 1...

simrangupta87541

INTRODUCTION TO ARTIFICIAL INTELLIGENCE BASIC

GOKULKANNANMMECLECTC

Technological Innovation Management And Entrepreneurship-1.pdf

tanujaharish2

Lateral load-resisting systems in buildings.pptx

DebendraDevKhanal1

Recently uploaded (20)

❣Unsatisfied Bhabhi Call Girls Surat 💯Call Us 🔝 7014168258 🔝💃Independent Sura...

❣Independent Call Girls Chennai 💯Call Us 🔝 7737669865 🔝💃Independent Chennai E...

Better Builder Magazine, Issue 49 / Spring 2024

Literature review for prompt engineering of ChatGPT.pptx

Call Girls Goa (india) ☎️ +91-7426014248 Goa Call Girl

Call Girls In Lucknow 🔥 +91-7014168258🔥High Profile Call Girl Lucknow

Update 40 models( Solar Cell ) in SPICE PARK(JUL2024)

Covid Management System Project Report.pdf

Sri Guru Hargobind Ji - Bandi Chor Guru.pdf

🔥Young College Call Girls Chandigarh 💯Call Us 🔝 7737669865 🔝💃Independent Chan...

SPICE PARK JUL2024 ( 6,866 SPICE Models )

High Profile Call Girls Ahmedabad 🔥 7737669865 🔥 Real Fun With Sexual Girl Av...

Cuttack Call Girls 💯Call Us 🔝 7374876321 🔝 💃 Independent Female Escort Service

AN INTRODUCTION OF AI & SEARCHING TECHIQUES

🔥Independent Call Girls In Pune 💯Call Us 🔝 7014168258 🔝💃Independent Pune Esco...

Call Girls Chennai +91-8824825030 Vip Call Girls Chennai

Mahipalpur Call Girls Delhi 🔥 9711199012 ❄- Pick Your Dream Call Girls with 1...

INTRODUCTION TO ARTIFICIAL INTELLIGENCE BASIC

Technological Innovation Management And Entrepreneurship-1.pdf

Lateral load-resisting systems in buildings.pptx