Zephyr 7b beta: paper deep dive, code, & RAG

Is Zephyr 7b beta the best fine-tuned smaller open-source LLM? It is fine-tuned on the best small open-source foundation model Mistral 7B, outperforms all small models, and even outperforms LLama2-Chat-70B and ChatGPT on multiple benchmarks.
What are the difference between Zephyr 7b alpha and Zephyr 7b beta?
From the author: "The main differences are (a) better dataset filtering of UltraChat, namely fixing grammatical errors and some unwanted responses and (b) training for longer, ie 3 DPO epochs vs 1"
Model: huggingface.co...
Technical report: arxiv.org/abs/...
Colab: colab.research...
LlamaIndex Tweet (colab link in the tweet): / 1718054631413363196
🔔 SUBSCRIBE to my channel: www.youtube.co...
⭐ Stay in touch ⭐
📚 DS/ML Book Club: dsbookclub.gith...
▶ KZbin: / sophiayangds
✍️ Medium: / sophiamyang
🐦 Twitter: / sophiamyang
🤝 Linkedin: / sophiamyang
💚 #ai