How To Run LLMs on iOS

[@_idiocracy]

great video! i wonder if it means we can run RAG on the device at some point?

[@earlymorningdev]

I definitely think that is already happening. I'm going to have to do a follow-up at some stage

[@kpopminj]

Is llm farm safe?

[@earlymorningdev]

Safe for what?

[@rasherobinson2428]

How can I get coping stuff from chat to work?

[@earlymorningdev]

Not sure I understand?

[@rasherobinson2428]

@@earlymorningdev inside ai chat. Not able to copy a text the ai writes.

[@massimilianosabato]

interesting, but it doesn't explain how to install it correctly on iOS and configure it

[@earlymorningdev]

I will be making a video on this at some point. Trying to build some apps to do this at the moment

[@sonarasubasinghe9402]

U didn’t show how to run the LLm but started in the middle of nowhere😢

[@earlymorningdev]

Check the repo. If you want me to do another video doing from scratch I can do that. Working on another llm idea soon