Рет қаралды 7,590
Slides: sebastianraschka.com/pdf/lect...
0:00 Introduction
0:29 BERT (Bidirectional Encoder Representations from Transformers)
1:44 BERT Inputs
4:18 BERT Pre-Training Task #1
9:47 BERT Pre-Training & Downstream Tasks
11:51 Transformer Training Approach
12:16 BERT Pre-Training & Fine-Tuning Approach
13:49 BERT vs GPT-v1 Performance
14:59 BERT Pre-Training & Feature-based Training
-------
This video is part of my Introduction of Deep Learning course.
Next video: • L19.5.2.4 GPT-v2: Lang...
The complete playlist: • Intro to Deep Learning...
A handy overview page with links to the materials: sebastianraschka.com/blog/202...
-------
If you want to be notified about future videos, please consider subscribing to my channel: / sebastianraschka