Profiling and Tuning PyTorch Models - Shagun Sodhani | PyData Global 2021

Profiling and Tuning PyTorch Models Speaker: Shagun Sodhani Summary PyTorch is one of the most popular Machine Learning frameworks and is commonly used for both research and production. However, in practice, users are often unaware of how to profile and tune their model and miss out on important performance wins. This talk covers the guidelines and best practices for profiling and tuning the models. Description Agenda: The talk will describe guidelines and best practices for profiling and tuning PyTorch models. Target Audience: People using/developing PyTorch models. Why is this talk important: Users are often unaware of how to profile and tune their model and miss out on important performance wins. Format: Talk using slides. No hands-on coding. Slides will have code snippets and screenshots. Outline: About 15 min: PyTorch Profiling 101 2-3 min: Code snippets/screenshots for showing how to setup PyTorch profiler. 7-10 min: Walking through