May 2-4, 2018 - Copenhagen, Denmark
Click Here For Information & Registration
Friday, May 4 • 09:40 - 10:00
Keynote: Scaling Deep Learning Models in Production Using Kubernetes - Sahil Dua, Software Developer, Booking.com (Slides Attached)

Sign up or log in to save this to your schedule and see who's attending!

Feedback form is now closed.
While there are a lot of machine learning frameworks and libraries available, putting the models in production at large scale is still a challenge. Sahil would like to talk about how they took on the challenge of deploying deep learning models in production: how they chose their tools and developed their internal deep learning infrastructure using Kubernetes. He will cover how they do model training in Docker containers, distributed TensorFlow training in a cluster of containers, automated re-training of models and finally, the deployment of models to serve predictions.

At the large scale which they operate on, nothing comes easy. He will also talk about how they optimize their model predictions infrastructure for latency or throughput depending on the use case.

avatar for Sahil Dua

Sahil Dua

Software Developer, Booking.com
Sahil is a software developer at Booking.com. He has been involved in leveraging container infrastructure to help Booking.com’s internal teams in taking advantage of deep learning techniques at scale. An open source software enthusiast, Sahil is a core contributor and community... Read More →

Friday May 4, 2018 09:40 - 10:00
Congress Hall A