The Lottery Ticket Hypothesis and pruning in PyTorch
In this video, we are going to explain how one can do pruning in PyTorch. We will then use this knowledge to implement a paper called “The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks“. The paper states that feedforward neural networks have subnetworks (winning tickets) inside of them that perform as good as (or even better than) the original network. It also proposes a recipe how to find them.
Paper:
Official code:
Code from this video:
00:00 Intro
00:50 Paper overview: Hypothesis (diagram) [slides]
01:33 Paper overview: Hypothesis (formal) [slides]
02:15 Paper overview: Finding winning tickets [slides]
03:44 Paper overview: Our setup [slides]
05:08 Pruning 101 in PyTorch [code]
10:29 Data - MNIST [code]
12:18 Multilayer perceptron [code]
14:05 Pruning: Linear MLP [code]
7 views
35
4
1 month ago 00:01:14 1
[Stash Magazine] The Making Of - Ca Lottery “Rabbit Foot Factory“
1 month ago 00:22:24 5
[] 15 Money Habits That Keep You Poor
1 month ago 01:02:21 179
Полный концерт NICKELBACK PRAGUE 2024 // the best concert i’ve ever seen
1 month ago 00:22:34 1
[SmugAlana] How A $3 Hotdog Uncovered a $24.7 Million Lottery Scam || Vince Vintage React
1 month ago 00:03:16 530
Pitbull | Bon Jovi - Now Or Never | 2024 | Official Video | 4K
1 month ago 00:11:06 56
Just For Laughs Gags “ Making People Think They Won The Lottery “ . г .
2 months ago 00:19:11 4
Разговорный английский: Вопросительная фраза “Are you serious?“
2 months ago 00:19:11 8
Английские вопросительные предложения: Are you serious
2 months ago 00:04:16 4
Вопросительное предложение Can you believe it? Частотные житейские фразы в английском языке
2 months ago 00:02:26 58
[Doggie] (VERIFIED) SLAUGHTERHOUSE by Icedcave and more // FORMER TOP 1
2 months ago 00:08:13 1
ШАНС УМЕРЕТЬ завтра, ВЫШЕ чем шанс ВЫИГРАТЬ В ЛОТЕРЕЮ! [JF]
2 months ago 00:44:04 29
Скорая помощь / ER | s01e13 | Счастливая лотерея / Luck of the Draw
2 months ago 00:44:27 146
1x10 - Luck of the draw (Лотерея) Скользящие. Параллельные миры
2 months ago 00:03:33 1
BREAKING: Elon Musk sued over GOP voter money giveaway | LiveNOW from FOX
2 months ago 00:15:50 7
Молодежный сленг: Blimey. Значение и примеры. Весь английский до автоматизма за год
2 months ago 00:24:45 55
06_Extra_English_-_Bridget_wins_the_lottery
2 months ago 00:06:05 1
MECHANICAL TECHNO DEMONSTRATION
2 months ago 00:02:16 1
Is this fate? The lottery result of the day Yibo won the GT championship coincides with his birthday
2 months ago 00:13:36 1
US Military Draft in 2025, Women Included!
2 months ago 00:08:04 1
DIY Denim Choker & Necklace With Denim Feathers
2 months ago 00:47:38 1
Короткометражный фильм “Не повезло“/ Bad Luck short film
2 months ago 01:28:34 1
Exploding Sun | Part 1 of 2 | FULL MOVIE | Thriller, Action | 2013
2 months ago 00:03:31 7
The Best Of Yaroslav Askarov | Hockey Highlights | HD