Events Add an event Speakers Talks Collections
 
SigOpt Summit 2021
November 16, 2021, Online
SigOpt Summit 2021
Request Q&A
SigOpt Summit 2021
From the conference
SigOpt Summit 2021
Request Q&A
Video
Hyperparameter Optimization of MLPerf Training with Habana Labs: SigOpt Summit 2021
Available
In cart
Free
Free
Free
Free
Free
Free
Free
Free
Free
Free
Add to favorites
34
I like 0
I dislike 0
Available
In cart
Free
Free
Free
Free
Free
Free
Free
Free
Free
Free
  • Description
  • Discussion

About the talk

Large scale deep learning training workload runtime optimization is computationally expensive, requires contributions from a multidisciplinary team, and relies on complex hyperparameter optimization techniques. Habana Labs developed a computationally cost efficient methodology to reduce the MLPerf training workload’s runtime, namely the reduction of the number of training epochs required to reach target accuracy.

In this talk, Basem Barakat, Large Scale Machine Learning Engineer, and Evelyn Ding, Senior Machine Learning Engineer, both from Habana Labs, discuss how their team utilized HPO to optimize runtime and tested two different methods in the process: home-grown Grid Search and the SigOpt optimization library. When comparing these two optimization methods, SigOpt provided a clear advantage over home-grown Grid Search in multiple ways. Habana Labs team will share their experience working through these challenging workloads and the insights they gained in the process.

About speakers

Basem Barakat
Large Scale Machine Learning Engineer at Habana Labs
Evelyn Ding
Senior Machine Learning Engineer at Habana Labs

As a large scale machine learning engineer at Habana, Basem leads efforts to accelerate AI workloads on Habana Gaudi and other Habana AI accelerator hardware, including collaboration with the team on MLPerf submissions. Previously, Basem was a senior performance architect at Samsung. Before Samsung, Basem was a senior systems engineer at Freescale. Basem holds a Ph.D. in Physics from the University of Houston.

View the profile

Evelyn is a a senior machine learning engineer at Habana Labs and previously occupied the same role for Intel. She focuses on data analytics, machine learning, application development, optimization and deployment for at scale machine learning and deep learning projects. Previously, Evelyn held advanced software engineering roles at Heristar, ExxonMobil, Dow and ENGlobal, among other companies. Evelyn graduated with a Ph.D. in Electrical Engineering from the University of Sheffield in the United Kingdom and received her bachelor’s degree in Electrical Engineering from the University of Science and Technology in China.

View the profile
Share
Cackle comments for the website

Buy this talk

Access to the talk “Hyperparameter Optimization of MLPerf Training with Habana Labs: SigOpt Summit 2021”
Available
In cart
Free
Free
Free
Free
Free
Free
Free
Free
Free
Free

Full access

Get access to all videos “SigOpt Summit 2021”
Available
In cart
Free
Free
Free
Free
Free
Free
Free
Free
Free
Free
Ticket

Similar talks

Ke Ding
Principal AI Engineer Intel at SATG MLP – Applied ML team
Available
In cart
Free
Free
Free
Free
Free
Free
Free
Free
Free
Free
Available
In cart
Free
Free
Free
Free
Free
Free
Free
Free
Free
Free
Michael McCourt
Head of Engineering at SigOpt
Available
In cart
Free
Free
Free
Free
Free
Free
Free
Free
Free
Free
Available
In cart
Free
Free
Free
Free
Free
Free
Free
Free
Free
Free
Jian Zhang
Senior Software Engineering Manager at Intel Corporation
Available
In cart
Free
Free
Free
Free
Free
Free
Free
Free
Free
Free
Available
In cart
Free
Free
Free
Free
Free
Free
Free
Free
Free
Free

Buy this video

Video
Access to the talk “Hyperparameter Optimization of MLPerf Training with Habana Labs: SigOpt Summit 2021”
Available
In cart
Free
Free
Free
Free
Free
Free
Free
Free
Free
Free

Conference Cast

With ConferenceCast.tv, you get access to our library of the world's best conference talks.

Conference Cast
909 conferences
36259 speakers
13921 hours of content
Basem Barakat
Evelyn Ding