STOP Building AI SaaS ONLY on OpenAI APIs!!!

[@1littlecoder]

Here is my vLLM Tutorial (with hands-on code) - kzbin.info/www/bejne/fWjViZ-Qh5tribM

[@quebono100]

I 100% agree with you, we have to push open source models for the sake of the mankind

[@1littlecoder]

Thanks for being on the journey!

[@DihelsonMendonca]

I agree with you. I think we need to push open source models.

[@spicer41282]

Refreshingly NOT regurgitating the useless Drama! THANK YOU! Please do a deep dive series on this! Take each one and discuss pros and cons. I see this as your Niche! Keep it coming!

[@ds920]

I don’t use closed source models, except for testing and basic study, I’m not even interested in that set of new things… it’s only now they know how to force model to answer in JSON!!! I knew it for several months now, and it’s even without training!!! and this knowledge is not even required with mistral.

[@shrishri333]

🎯 Key Takeaways for quick navigation: 00:54 📢 *The video is not sponsored; the speaker's recommendations are based on personal experience and opinion.* 01:09 🌟 *Replicate is highly recommended for image generation, especially for independent developers.* 01:50 🚫 *Popular cloud solutions like AWS, Microsoft Azure, and Google GCP are intentionally omitted from this discussion.* 02:17 🧠 *Hugging Face's Inference Endpoint is a notable solution for deploying AI models with various cost options.* 05:02 💡 *Emphasizes the importance of having fallback solutions and a tiered approach in AI development for reliability.*

[@hankscorpio182]

The future's so bright, He's gotta wear shades !!

[@ZeyadAlmothafar]

Thanks a lot for the video, however there is big problem in all of these solutions, all of them are not powerful if you want to serve MultiLingual SaaS. this is the biggest thing that led me to use Openai API for my SaaS.

[@1littlecoder]

I can understand that but like I mentioned in the video these are could augment well as supplements. But your points stay true that the main meal could be openai for a lot of usecases.

[@ds920]

Thank you so much again, sir! Your channel is the absolute best.🎉

[@Tripp111]

Runpod community pods are distributed and cost-effective.

[@IronMechanic7110]

I leave OpenAI like Sam Altman.

[@1littlecoder]

Poetic!

[@starbuck1002]

Again and again and again, great video. Thanks so much man!

[@rashshawn779]

Please push more non-openai, open source or self hosted solutions. Also hightlight and be honest on their problems, and potential tradeoff and solution for the problems.

[@1littlecoder]

Yes tried to highlight some problems in this video as well. Will continue to do zo !

[@rashshawn779]

​@@1littlecoderYou are doing great 👍

[@GAllium14]

I think we can try fireworks ai api it's great and has most of the open source models🎉

[@paroleschansons7841]

Thank you so much you made it all clear 👌

[@1littlecoder]

Glad it helped!

[@StudioTatsu]

Claude 2.1 just went up to 200k tokens,and they lowered the price today.

[@henkhbit5748]

Thanks for the video about api inference👍. Open source is my favor 2

[@bibinkunjumon]

Anthropic not available for use..api

[@1littlecoder]

The API has its own waiting list so it might take time I guess

[@the10xdev]

I’ve trusted open source LLM’s but unfortunately none of them are close to gpt4.

[@tijendersingh5363]

which service provide statefull api?

[@Tripp111]

Thank you. What about S-LoRa? And, tinygrad?

[@prestonmccauley43]

I just started digging into llamaindex. I'm attempting to build my own datalake. Know of any tools for the data viz side of the LLM?

[@tyessenov]

What about non English and non European languages LLMs?

[@ArtisanTony]

I missed the part where you explain why to stop using OpenAI APIs. I am still looking for help connecting an openai assistant with my Joomla 4 site. I think Joomla is blocking http requests.

[@1littlecoder]

Good to see Joomla in 2023 :) why do you think it's blocking ? Is it allowing normal requests?

[@ArtisanTony]

@@1littlecoder Yes, I have been using Joomla for 16 years :) but I am not a coder. I have this custom html module that allows php and scripts so I have the php that includes the openai api and assistant ID but I cannot get seem to get it to connect with the api key or assistant ID I need to pay you to help me :) But yes, normal 3rd party jomla ai modules will connect. I just cannot get my custom module to connect so I can use an assistant that I can configure on the openai site

[@1littlecoder]

Can you mail me 1littlecoder at gmail let's see

[@rohithreddy75]

Can i know your name? I wanted to ask what googles are you using to protect your eyes?

[@quotesspace1713]

Great video as always 🙏🙏 I have tried LLaVA(upload image and ask question) with image with text on it but it could not extract the text on the image. can you please suggest an alternative to do this. Thank you

[@1littlecoder]

There was a comment here suggesting you to try tesseract, strangely it's not there now, maybe youtube removed it! But tesseract is something you can try if you're trying to do only OCR!

[@quotesspace1713]

@@1littlecoder thanks bro. is there a way to do both automatically based on the input image

[@ds920]

@@quotesspace1713yes, there is, you can just script this pipeline now in python, I did that - generated description, made model look at it, and suggest fixes, apply fixes with the model and again😂

[@Moyemor]

​@@quotesspace1713try document ai or Google OCR in chrome browser

[@nithinbhandari3075]

Thanks

[@1littlecoder]

You are very welcome Nithin!

[@ismaila8045]

Thanks, great content as always

[@agnivamahata3870]

Can you make a video for text gen too?

[@velugucharan8096]

Bro show api which are free to user so that we can practice some things

[@zyxwvutsrqponmlkh]

Anything I do for serious is not running anything closed. I have a hard time understanding why anyone would trust another company for their livelihood if they had a choice.

[@1littlecoder]

What's your favorite model now?

[@zyxwvutsrqponmlkh]

@@1littlecoder TheBloke • neural chat v3 1 7B or Yarn-Mistral-7b-128k depending on the task. I use the chinese stuff for interrogating images. And I do regrettably still use gpt4 for some coding help but I don't hook into the api for anything in production.

[@IntellectCorner]

helpful.

[@TheBestgoku]

I find problems and then find solutions. I don't obsess over tools.

[@jorick808]

frist post

[@gitasuputra8371]

why did you use sun glasses, brother? did you get eye-ache?

[@dummylopez6094]

is there any reason why you are wearing sunglasses? does it add value to your speach?

[@CapnSnackbeard]

Him leaving has everyone realizing how bad his idea of pushing so hard for market dominance was. Centralizing AI under one company, and all other major companies becomming leashed to that is just another way of materially centralizing the nervous systems of those companies. In other words: a really bad idea.

[@olafge]

The sunglasses are cool, but why?

[@aimademerich]

Style points baby!!😎

[@varunpro1]

Maybe suffering from an eye flu or followed open AI drama night and day 😅 😉

[@FindMultiBagger]

bhai ye goggle accha nhi dikh raha hai

[@MODEST500]

Bro why are you wearing huge glasses. Hope you are fine

[@tyessenov]

What about non English and non European languages LLMs?