🔴 Mixture of Agents (MoA) Method Explained + Run Code Locally FREE

[@soccerdadsg]

Another quality video from the channel!

[@analyticsCamp]

Much appreciated!

[@sr.modanez]

top top top + + + + + +👏👏👏👏👏👏👏👏👏

[@analyticsCamp]

Glad you liked it and thanks for watching :)

[@OpenAITutor]

I love this! I did create a version using Groq and open-webui!

[@analyticsCamp]

Thanks for your comment. I visited your channel and subed! Great videos :)

[@BooleanDisorder]

Next will probably be: Mixture of Mixtures!

[@analyticsCamp]

LOL :) Who knows? Maybe you're right!

[@BooleanDisorder]

​@analyticsCamp seriously though, thanks for the excellent video.

[@jeffg4686]

what if the models you choose are different for different agents in the various layers. Such as layer 1 has Agent 1 (llama3.1), Agent 2(mixtral7b), Agent3(gemma) layer 2 has Agent 1(chatgpt 4), agent2(mixtral7b), agent3 (llama3) Also, can the layers have different numbers of agents - I assume so, but not sure.

[@analyticsCamp]

Hi, yes you can effectively do all that. If you see the video at 06:05 you see there are four different models for the layers with Qwen2 acting as the aggregator. If you take a look at the MOA diagram, you'll see each agent/LLM is depicted with a different colour (A1, A2, A3) in each layer, so in their current set-up in each layer the number of 'reference models' defined by the user will separately produce the intended result, and they get aggregated at the final output (depicted as A4). Yes, I think you can tweak the code to have a different number of agents per layer too; please check their GitHub repository, the bot.py file ( I haven't done that personally). Thanks for your comment :)

[@jonjeffers5153]

Thanks for the video! I'm having an issue with the API key. I'm not a python programmer, FYI. The bot.py runs, but when I type something I get: OpenAIError: The api_key client option must be set either by passing api_key to the client or by setting the OPENAI_API_KEY environment variable

[@analyticsCamp]

Hi, I think you have not set your environment variables correctly (Please follow the video steps). You should either have a valid OpenAI API key (can get it from their website) or just get a free key from the Together AI website for this project. Then, from your code editor terminal, export your environment API key by typing this exactly: echo "export OPENAI_API_KEY='yourkey'" >> ~/.bash_profile -but replace 'yourkey' with the key ID you got (it doesn't have to be only from OpenAI, but any partner of them like Together AI, etc). Then update the shell with the new variable by typing: source ~/.bash_profile -to confirm if it is set correctly, type: echo $TOGETHER_API_KEY -This should show your key, if it is correct you are set. I hope this helps :) PS: if you work on Windows, I think you should use \ instead of / in my code, and instead of bash_profile in the first two lines, use autoexec.bat. I don't work with Windows but this information that I found online may help: To set environment variables in Windows, you can follow these steps: Press Win + R to open the Run dialog. Type sysdm.cpl and press Enter to open the System Properties window. Go to the "Advanced" tab and click on the "Environment Variables" button. In the Environment Variables window, you can set system variables (for all users) or user variables (specific to the current user). Click on "New" to add a new variable, or select an existing variable to edit or delete it.