bitnet.cpp from Microsoft: Run LLMs locally on CPU! (hands-on)

[@waffleninja1000]

Does anyone know a good, reliable jailbreak for the llama3 100B model?

[@AK-ox3mv]

Its llama 3 8B. What that "100B" at the end of model name means? Llama is either 8B or 100B! What it mean?

[@AIBites]

so 100B is for billions of parameters. The more the params, the model is supposed to be better. 8b, 4b or 2b stands for bits in quantization. We use quantization to reduce the model size to make it run locally on our laptops or CPU desktops.

[@amssss4152]

Count R's in a word is not a good way to evaluate model since it Depends on tokenizer. I read this on reddit. Anyway just wanted to add.

[@AIBites]

Yes that's very true.. It's just becoming overrated in the hype and everyones using it 😊