Best Small LLM Model For Smartphone (How to run them)

[@Windswept7]

Would be good to know which small models are the best at specific tasks like coding.

[@magickaito5496]

why would you run a code model in your phone

[@Windswept7]

@@magickaito5496 why wouldn’t you? In the real word there are problems to be solved in places with no internet access.

[@scifilogic]

I should have mentioned it in my video, but for coding tasks on a mobile device, I recommend a model that I recently merged. This model is creative, uncensored, and decent at coding for its size: huggingface.co/bunnycore/Gemma-2-2b-All-in-One