Stanford CS25: V4 I Aligning Open Language Models

April 18, 2024
Speaker: Nathan Lambert, Allen Institute for AI (AI2)
Aligning Open Language Models
Since the emergence of ChatGPT there has been an explosion of methods and models attempting to make open language models easier to use. This talk retells the major chapters in the evolution of open chat, instruct, and aligned models, covering the most important techniques, datasets, and models. Alpaca, QLoRA, DPO, PPO, and everything in between will be covered. The talk will conclude with predictions and expectations for the future of aligning open language models. Slides posted here: docs.google.com/presentation/...
All the models in the figures are in this HuggingFace collection: huggingface.co/collections/na...
About the speaker:
Nathan Lambert is a Research Scientist at the Allen Institute for AI focusing on RLHF and the author of Interconnects.ai. Previously, he helped build an RLHF research team at HuggingFace. He received his PhD from the University of California, Berkeley working at the intersection of machine learning and robotics. He was advised by Professor Kristofer Pister in the Berkeley Autonomous Microsystems Lab and Roberto Calandra at Meta AI Research.
More about the course can be found here: web.stanford.edu/class/cs25/
View the entire CS25 Transformers United playlist: • Stanford CS25 - Transf...

[@SebastianRaschka]

This talk and the slides are gold! Love the whirlwind tour of the BC (Before ChatGPT) and AD (After Deployment of ChatGPT). How fast time went by ... I barely remember Vicuna, and it was just a year ago :D

[@nafikhan13-4-23]

I love 💓💓💓💓Stanford Online💓💓💓💓

[@mahirturjo7509]

❤❤❤❤❤❤

[@user-wr4yl7tx3w]

Shouldn’t there be a different KZbin channel for AI from Stanford.

[@raul36]

If AI is aligned then it is not AGI.

[@TheAlphaWavePodcast]

Stanford has thirst traps? Who knew?

[@CannabinatedFantasy]

omg his forehead

[@TheAlphaWavePodcast]

I have a PhD in law and I have gone through the arduous process of establishing a very viable patent, trademark and copyright case that I am sure can help Nathan trademark his forehead so we can sue the creators of the film Megamind for billions. Please Nathan, contact me.