The Quest for Community-Trained Open Source AI Models

[@AdvantestInc]

The concept of community-driven AI is inspiring! Truly exciting to see where decentralized collaboration will take the field.

[@rolestream]

Awesome! Thank you for this! =)

[@a16z]

0:41 What is Nous Research? 4:02 Jeff's and Bowen's backgrounds 9:27 Open source Hermes models 15:28 Deciding what to work on 17:30 Overcoming research bottlenecks in Hermes 19:00 The catalyst for DisTrO (the risk of open source AI slowing down) 21:47 Training AI models over the internet 26:36 Kicking off the DisTrO research 30:08 An 857x reduction in bandwidth requirements 33:16 Addressing skeptics and encouraging replication 41:02 Does a SETI@home for AI change the GPU market? 49:54 Developing a "product" organically 54:04 Can the community train a Llama equivalent? 57:21 Unexpected discoveries during DisTrO research 1:04:25 Orchestrating distributed training runs 1:10:48 You still need backpropagation 1:13:02 ASICs and inference

[@ChairmanHehe]

openai but for real this time(?)