Thanks DevBytes

Do you have any recommended setup for a computer where you don't want to risk running an untrusted binary? For example, unlike Android, on Windows, any application you run even once can have permanently taken control over your system, forever stealing all your accounts in all apps. One of the obvious solutions would be to only use web versions of the apps via browser, and to run both the web apps and your AI model servers in a Docker. If you have multiple computers, it would also be preferable to share their resources, which you'd probably control via Kubernetes to be able to describe and orchestrate a more complex setup... I'm feeling that tutorials are very lacking in this common sense way of requiring security. (Also, when running ollama in WSL2, my WSL stopped working with an error regarding insufficient resources, which blocked me from using it at all, so it's quite non-trivial to set up even a simple thing such as containerization nowadays with how everything works as a black-box.)

Is it free?

amazing

I spent around 4 hours trying to do this from Windows Subsystem for Linux. I'm glad to see that it is so much easier from MacOS.

transferring model data Error: unsupported content type: text/plain; charset=utf-8 FROM llama3:8b PARAMETER temperature 1 PARAMETER stop <|start_header_id|> PARAMETER stop <|end_header_id|> PARAMETER stop <|eot_id|> PARAMETER stop <|reserved_special_token TEMPLATE """ {{ if .System }}<|start_header_id|>system<|end_header_id|> {{ .System }}<|eot_id|>{{ end }}{{ if .Prompt }}<|start_header_id|>user<|end_header_id|> {{ .Prompt }}<|eot_id|>{{ end }}<|start_header_id|>assistant<|end_header_id|> {{ .Response }}<|eot_id|> """ SYSTEM You are a helpful AI assistant named LLama3. Please provide the aspects discussed in the following Bengali product review. Please only consider the aspects from the following list of aspects: product, service, delivery, packaging, seller, rider, price, shelf. can you tell me why i am facing this error? I followed all the steps as you did.

Hello, it's works but only if I use terminal, with OllamaWebUi not, you know why ? Thx

Great Video. Thanks for doing this.

For those having issues at around the 35min mark, you need to ensure that your role and function can access the internet aka. 'VPC'. Change those setting in the IAM menu for your user. Once that permission is added (AWSLambdaVPCAccessExecutionRole), you go back to configuration in the function and go down to VPC.

Please help with this: **(venv) (base) iamal@IAMALs-MBP suede % ollama create my-llama3-model -f /Users/iamal/Desktop/suede/custom-llama3.yaml** Error: command must be one of "from", "license", "template", "system", "adapter", "parameter", or "message"

when running this in the terminal: "ollama create my-llama3-model -f custom-llama3.yml" I get this error: Error: command must be one of "from", "license", "template", "system", "adapter", "parameter", or "message"

How do we fine tune the model? Do you have a video on it?

Which extension do you use to create the custom -llama3 Pls help

It's not universal across Linux, but many distributions have depricated the ifconfig command for getting the network ip address. One command you can use to get this is 'ip address show | grep inet' which should give you a list similar to ifconfig on the mac, and will include ipv6 addresses if you have ipv6 enabled. Lan specific ipv6 addresses will begin 'fe80:' and should be available to all hosts within the local network. If you have ipv6 addresses other than this and '::1' you may want to make sure that your network is blocking external traffic for any services you don't want to share outside of your lan. At the moment, my openUI service does not appear to be attaching to the IPv6 stack, however that is potentially subject to change in the future. You can always ask an llm how to connect to a server's ipv6 address and you should get some possibly useful responses, however if the service isn't attaching to ipv6, it's not going to work. Now if I could find a way to get OpenUI on a docker server, at a locally significant hostname, to connect to a system running ollama (because while the docker server doesn't have a graphics card capable of givving happy response rates, the game system does, and can be used while I'm not gaming for that. However it looks like ollama isn't attaching to any of the hardware nic ipv4 addresses so far. I'll get it worked out eventually. (maybe?)

thank u. new subscriber !

Thanks for acting on my suggestion and making this video. As always, great content. Keep up the great work!

Thank you @stanleykwong6438 for the video idea. Here are other Open WebUI videos you may like: ULTIMATE Llama 3 UI: Dive into Open WebUI & Ollama! kzbin.info/www/bejne/emWrZpuDgtSNaJo ULTIMATE Llama 3 UI: Chat with Docs | Open WebUI & Ollama! (Part 2) kzbin.info/www/bejne/oXXadnydotaUe6c Open WebUI & OpenAI DALL-E 3: Effortless Text to Image Generation kzbin.info/www/bejne/enm5gmSLd8aMg7M

Thanks for the informative video. Would it be possible for me to chat with my own pdf documents?

My friend, I love your videos and I wanted you to explain to us how to use n8n .. I want to use it to automate everything possible in my daily use

Why you are showing us UI with completely oh "hellow word" code. Is it possible to do something harder? Can you change the design with feedback? Can you setup the style library to have consistent components?, generate a few options to select from?

This works for HTML only or can we use it to prepare Java and Python based UI?

And does generating html component from image via ollama work for you? I get an Error! 500 Internal Server Error: object of type bytes is not JSON serializable

Thanks DevBytes

🧑‍💻 Commands for setting up OpenUI Be sure you have Python installed: www.python.org/downloads 🧑‍💻 Ollama Mac Setup: kzbin.info/www/bejne/ZmStkI1se7-LipY 🪟 Ollama Windows Setup: kzbin.info/www/bejne/e2bOkHyio9KYnsU OpenUI Setup Commands 👇 Command 1: git clone github.com/wandb/openui Command 2: cd openui/backend Command 3: pip install . Command 4: export OPENAI_API_KEY=xxx Command 5: python -m openui

i've been trying to get my own models setup and your series of videos have been exceptionally clear, please post more videos for an indepth use of Open WebUI and perhaps for the following so that non-technical people like me can implement it. 1. How to setup and allow other computers with WebUI installed to access the computer that has ollama installed on the same network. 2. How to setup "My Modelfiles" within WebUI, specifically how the Content section of the Modelfile is compiled, and how to incorporate other parameters beyond temperature. Exceptional work! I will spread the word with my team. Keep it up.

any chance you can please make one using Automatic1111 connecting to a local instance of stable diffusion or any open source image generator please? I've been trying to get it working but seems to get stuck on saving when ever I try to connect to the local instance with api mode active. any info on this would be amazing! thank you for another great video! <3 <3 <3

Where can get the ollama run ollama: instruct model? The closest that I found was ollama run meta-llama/Meta-Llama-3-8B-Instruct which does not work form hugging faces

I got it set up! Thank you for the quick guide!! Dev would you make a video on how to setup lobechat as well? It's a very interesting piece of front end. But hosting locally, I found it quite challenging since I'm not too technical in self hosting apps on the Mac.

How much on average does it cost to generate. I know itll be based on tokens. Just after a ballpark

Can you show how to connect sdforge it’s for computers with lower graphics

Thank you @vjrocker007 for the video idea. Part 1 & 2 of this series can be found below. 📺 PART 1 - ULTIMATE Llama 3 UI: Dive into Open WebUI & Ollama! kzbin.info/www/bejne/emWrZpuDgtSNaJo 📺 PART 2 - ULTIMATE Llama 3 UI: Chat with Docs | Open WebUI & Ollama! kzbin.info/www/bejne/oXXadnydotaUe6c

Thanks!

I like the clear presentation a lot. Thanks.

Hi can you provide the specs of your GPU use for this project to get better experience and smooth response.

I can't seem to comprehend how to provide access to my AI through OpenWebUI via my domain. I'd like to grant access for my family but I for the life of me can't seem to get it set up for public access.

Hi, I noticed your job post on Upwork about hiring an editor, and I'm interested in that position. Could we schedule a chat to discuss further?

Amazing video! thank you for sharing! Bytes could do a video tutorial on setting up image generation from Dall-E through webUI as well? That would be really helpful.

You're a legend, thank you for posting these how to videos. Keep it up, for a person who doesn't have time to go through all of these docs these have been incredibly helpful. Appreciate all of your hard work!!

hi, I am trying to make a model file with these configurations: # Set the base model FROM llama3:latest # Set custom parameter values PARAMETER num_gpu 1 PARAMETER num_thread 6 PARAMETER num_keep 24 PARAMETER stop <|start_header_id|> PARAMETER stop <|end_header_id|> PARAMETER stop <|eot_id|> # Set the model template TEMPLATE "{{ if .System }}<|start_header_id|>system<|end_header_id|> {{ .System }}<|eot_id|>{{ end }}{{ if .Prompt }}<|start_header_id|>user<|end_header_id|> {{ .Prompt }}<|eot_id|>{{ end }}<|start_header_id|>assistant<|end_header_id|> getting Error: unexpected EOF Could you tell me what am I doing wrong?

Hey mate, this is absolutely awesome, thanks so much. I'm wondering how well this would work at Knowledge Bases? Ie lets say I'm a decent sized company that has a huge internal wiki covering all sorts of internal processes that guides our employees in how to operate the business. Do you think I could upload all our wiki articles to the documents section and then give this to our team to be able to talk to our own internal chatbot to ask questions about what they should do in certain situations? Or do you think uploading very large amounts of documents would sort of overwhelm it and not produce great results? i.e do you think to achieve this outcome you'd actually need to fully retrain the base llama3 model itself rather than just adding documents on top of an existing stock llama3 model? Because as far as I can tell in my laymands understanding of all this is that when you upload documents, each prompt you enter it's having to kinda look through it all for an answer where as if you re-trained the base model it would know it more "naturally" haha. Sorry, not sure if I've explained that very well.

I tried this setup but the RAG in WebUI is absolutely atrocious. Maybe I'm just not having a great time because I'm on a Windoze machine, or maybe I messed up somewhere but my conversations seem to have VERY hit & miss accuracy when working with docs. I have tried compiling all docs into a master doc, I've tried using multiple small docs. I've tried .doc, .md, .txt, .csv with varying levels of success. It just seems like it's great in theory and not so much in practice. Like it's really cool that it's available and working, but as far as using it in my every day life -- probably not.

do you think you will need more than m3 max 36gb 14cpu/30gpu for running all these models im thinking of getting one myself to try all these models all i know that i need a capable device , btw thank you so much for your videos once i get this device im sure i will be around your channel alot benefiting from your experience thank you

when running the docker command I get this error: %2Fdocker_engine/_ping": open //./pipe/docker_engine: The system cannot find the file specified. See 'docker run --help'. any help ?

Thanks mate, I have a question. Can I add my text to llama3?

Brilliant thanks!

Which embedding model did you use for the document chat?

thank u man you now have a new sub

PART 1 can be found here -> ULTIMATE Llama 3 UI: Dive into Open WebUI & Ollama! kzbin.info/www/bejne/emWrZpuDgtSNaJo

So, what's the point of "customizing" when I can just change the system prompt? Isn't it like copying /bin/ls to /bin/myls and feeling like I accomplished something?

my computer did now have good gpu,can you make a video about how wo use cloud ollama and local webui?