PEGASUS Explained!

[@connor-shorten]

1:45 A Better Aligned Pre-training Objective 2:53 PEGASUS Architecture and Gap Sentences Generation pre-training 4:45 Inspiration from T5 6:22 HugeNews pre-training dataset 7:15 Downstream Abstractive Summarization Datasets 9:15 Ablations of Gap Sentences Generation 14:23 Results 16:17 Low-Resource Summarization 17:10 Human Evaluation and Examples of Generated Summaries 19:01 PEGASUS vs. BART 20:00 WikiSum Dataset 21:25 Comparison with Ideas in GPT-3

[@lightningblade9347]

Finally! A technical deep learning channel which doesn't have its last video 8 months ago. Keep up the good work!

[@connor-shorten]

Haha, thank you so much! I also recommend checking out Yannic Kilcher's videos!

[@juanmanuelcirotorres6155]

I need exactly this video for a presentation in my master, thanks a lot

[@juanmanuelcirotorres6155]

I need to present this paper in a class and find a video with an explanation by you is just... awesome

[@connor-shorten]

Awesome, really glad to hear it!

[@PeterOtt]

Perfect timing, I had just heard about the model and was interested in trying it out for myself. Similar to pegasus, your videos are pre-training for me, in a sense, before I actually go and read the paper and try out the technique. (someone said this pre-training part before, not my original meme)

[@connor-shorten]

Haha! I use yannic's videos in the same way!

[@erikacardenas2964]

Great video!

[@Schematical]

Interesting stuff. Keep up the great work.

[@connor-shorten]

Thank you!

[@aqibfayyaz1619]

Awesome Explanation

[@pepe_reeze9320]

What's your opinion on adapting the pretrained PEGASUS model to a different domain (e.g. German)?

[@manumaneesh9543]

It was very helpful, keep up the good work 😊

[@mehermanoj45]

Yay!

[@karimfayed4517]

I'm confused about if PEGASUS deal with noise in text or not, otherwise Great WORK!!

[@TechVizTheDataScienceGuy]

Is it still SOTA? Also, it looks like an extension to T5 objective like from span to sentence apart from prefix context.

[@rajxtverma]

What was the compute used for pre training this?

[@xinc405]

wish be helpful if you speak slower😂