Loading…
May 2-4, 2018 - Copenhagen, Denmark
Click Here For Information & Registration
Back To Schedule
Wednesday, May 2 • 11:10 - 11:45
Making Big Data Processing Portable. The Story of Apache Beam and gRPC - Ismaël Mejía, Talend (Any Skill Level) (Slides Attached)

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Tweet Share
Feedback form is now closed.
Big data applications have been an almost exclusive domain of Java and Scala developers. This not only frustrates engineers who prefer other languages and their ecosystems, but also impedes companies that already have their business logic written on other platforms from achieving the benefits of reuse when they build data-intensive applications.

In this talk we introduce Apache Beam. A unified programming model designed to provide efficient and portable data processing pipelines. We will discuss in detail how Beam achieves portability by relying in two concepts: (1) Runners that translate the Beam's model so it can be executed in existing systems like Apache Spark and Apache Flink and (2) the portability APIs, an architecture of gRPC services that coordinate the execution of pipelines in containers to accomplish language portability.
Speakers
avatar for Ismaël Mejía

Ismaël Mejía

Senior Cloud Advocate, Microsoft
Ismaël Mejía is a Senior Cloud Advocate at Microsoft working on the Azure Data and AI team. He has more than a decade of experience architecting systems for startups and financial companies. He has been recently focused on distributed data frameworks, he is an active contributor... Read More →

Making Big Data Processing Portable. The story of Apache Beam and gRPC Ismael Mejia (iemejia) pdf
Wednesday May 2, 2018 11:10 - 11:45 CEST
Auditorium 15
  gRPC, Any