2.5 72B Q5 is my daily now. Coder 7B Q8 is also running for quick questions
@Sean_neaS25 күн бұрын
Personally I'd rather see examples than benchmarks. Pull it up on hugging chat or ollama and let me know what kind of CPU or GPU ii need. Maybe home much an api costs.
@zyxwvutsrqponmlkh25 күн бұрын
Always been a fan of the Qwen models
@1littlecoder25 күн бұрын
Highly underrated
@nishanthvenkat586024 күн бұрын
How do you keep yourself updated with all these models on a daily basis. Any newsletter you subscribe to ? Or is there any other sources. Just curious
@snapo175024 күн бұрын
i stopped using llama as soon as the qwen 2.5 32B model came out... with 2 GPU's i run it in q8_0 , the model is absolutely badass good....
@1littlecoder24 күн бұрын
Are using a multi GPU set-up?
@alx843925 күн бұрын
I was able to run it on CPU only with 32 Gb of DDR5 RAM. IQ1 quant :) it was slow, yeah, but it works and still demonstrates a lot of intellect
@winterclimber752025 күн бұрын
the Alibaba guys are unbelievable. i use agentscope literally every day, can't wait to try it with the qwen 2.5 models
@xhridhar25 күн бұрын
How’s Qwen 2.5 compared to Molmo ? Can you do a comparison please ?
@TheRealUsername22 күн бұрын
Hi, I think you should look up Liquid AI's LFM models, they are built with a novel type of neural net and they reportedly outperform Transformers.
@dhruvmehta237725 күн бұрын
Have you tested the llama 3.2 90 billion?
@ilianos24 күн бұрын
(not finished watching this vid, but) it still can't answer all of my questions about a venn diagram
@1littlecoder24 күн бұрын
What kind of question did you ask with a Venn diagram?