Math4ML Exercises: Probability

In this video, W&B Deep Learning Educator Charles Frye and ML Engineer Scott Condron work the final exercises of the Math for Machine Learning course, on probability. To try out the exercises yourself, head here: For the Math4ML lecture on probability, head here: For an introduction to this exercise series, head here: Check out the other Math4ML videos here: Blogpost on surprise and information theory: 00:00 - Teaser 00:30 - Intro 01:42 - Implementing entropies 02:32 - Exercise: surprise 04:46 - Why do models output probabilities? 06:53 - Exercise: entropy 10:58 - Exercise: crossentropy 14:05 - Exercise: divergence 17:51 - Loss functions and surprises 20:01 - Exercise: softmax_crossentropy 23:01 - Putting it all together with Gaussians