Continual Learning in Neural Networks: on Catastrophic Forgetting and Beyond [in Russian]
Slides:
Speaker: Polina Kirichenko, New York University
Learning new tasks continually without forgetting on a constantly changing data distribution is essential for real-world problems but is challenging for modern deep learning. Deep learning models suffer from catastrophic forgetting: when presented with a sequence of tasks, deep neural networks can successfully learn the new tasks, but the performance on the old tasks degrades.
In this talk, I will present an overview of the continual learning algorithms including well-established methods as well as recent state-of-the-art approaches. We will talk about several continual learning scenarios (task-, class-, and domain-incremental learning), review the most common approaches in alleviating forgetting and discuss other challenges in the field beyond catastrophic forgetting (including forward & backward transfer, learning on continuously drifting data and continua
2 views
781
184
3 weeks ago 00:20:33 1
Movie “Wicked” Sign of the End Time
2 months ago 00:18:50 1
The Power of Diesel: Inside the Engine | Shell Historical Film Archive
2 months ago 01:04:57 1
A Message from the Stars (1111hz) | 1 hour handpan music | Malte Marten
2 months ago 00:03:37 16
Nuclear Power Trio - A Clear and Present Rager (OFFICIAL VIDEO)
2 months ago 00:09:05 1
Zoe Jakes & Faisal Zedan DRUM & BELLYDANCE performance at The Massive Spectacular! {2023}
2 months ago 00:11:38 1
Bashar Beethoven Meditative 3xLoop - 7th Symphony 2nd Movement Allegretto
2 months ago 00:04:23 1
Delta Force | PC Global Open Beta Cinematic Trailer: Genesis
2 months ago 00:00:31 1
God of War Ragnarök - Launch Trailer | PC Games
2 months ago 00:54:25 1
Boost energy and reduce cravings with these hacks | Glucose Goddess Jessie Inchauspé & Tim Spector
2 months ago 00:00:12 1
The purpose of practicing combat is to counter every move with a response #combat #shorts
2 months ago 00:10:09 1
Marriage and the Family [What Does God Intend Them to Be?] – Pastor Ted Wilson
2 months ago 00:04:13 1
SEVDALIZA - WOMAN LIFE FREEDOM زن زندگی آزادی
2 months ago 00:11:02 1
How to Raise a Baby Bobcat (for Meat!)
2 months ago 00:06:24 1
4. КАК СОСТАВИТЬ ВОПРОС В PRESENT CONTINUOUS | НАСТОЯЩЕЕ ДЛИТЕЛЬНОЕ ВРЕМЯ | Learn English
2 months ago 00:07:12 1
Герундий в английском языке
2 months ago 00:11:12 2
Devlog #3 - Forbidden Learning
2 months ago 00:15:18 1
Who Really Is ABRAXAS? The Secret Religions DON’T Want You to Know
2 months ago 00:03:10 1
Johnny Blaze The Fiery Origins and Dark Legacy of Marvel’s Ghost Rider
2 months ago 00:00:15 1
The Life of KiLLMiLk Golden Chains, Luxury, and Unique Style!
2 months ago 00:03:44 1
Nuclear Power Trio - Grab ’Em by the Pyongyang (OFFICIAL VIDEO | 5K)
2 months ago 00:03:31 1
Tiny Moving Parts - “Caution“ (Official Video)
2 months ago 00:05:15 1
2500 Montréalers sing L. Cohen’s “Hallelujah” in perfect harmony at Place Des Arts
2 months ago 00:33:14 1
4 Levels to creating realistic bubbles in blender
2 months ago 00:56:01 1
Go Hard or Go Hardcore - Mindmistake | HÖR - April 25 / 2024