For more information about Stanford’s Artificial Intelligence professional and graduate programs, visit:
Topics: Generalization, Unsupervised learning, K-means
Percy Liang, Associate Professor & Dorsa Sadigh, Assistant Professor - Stanford University
Associate Professor Percy Liang
Associate Professor of Computer Science and Statistics (courtesy)
Assistant Professor Dorsa Sadigh
Assistant Professor in the Computer Science Department & Electrical Engineering Department
To follow along with the course schedule and syllabus, visit:
#schedule
0:00 Introduction
0:34 Review: feature extractor
0:53 Review: prediction score
1:18 Review: loss function
3:42 Roadmap Generalization
3:58 Training error
4:26 A strawman algorithm
5:15 Overfitting pictures
5:51 Evaluation
9:20 Approximation and estimation error
11:27 Effect of hypothesis class size
12:51 Strategy 1: dimensionality
13:34 Controlling the dimensionality
14:21 Strategy: norm
24:21 Controlling the norm: early stopping
27:34 Hyperparameters
30:22 Validation
36:18 Development cycle
55:08 Supervision?
58:12 Word vectors
58:58 Clustering with deep embeddings