Complete Generative AI With Azure Cloud Open AI Services Crash Course

[@krishnaik06]

Lets keep the target of the likes to 2000. Also dont forget to subscribe his YT channel.

[@ajitkumarsingh1]

Hi sir, I want to create an AI power chat application which will query with MS SQL server database. Is this possible to implement using free ai models? Plz make a video for this. Don't want to download models on local system also.plz make a video like this also if feasible.

[@biswajeetjena977]

1 like added

[@neerajshrivastava5600]

This is a high quality content, I have been working on Azure AI from last few months, I can say you covered all key features very well

[@AjinJoseph7]

This is amazing content. A vast amount of knowledge is shared in just 3 hours. The knowledge I gained in this video will elevate my professional career.

[@КравчукІгор-т2э]

Thank you! As always everything is interesting and clear! From the bottom of my heart I wish you success and prosperity!

[@yumyum3876]

He should be awarded Bharat Ratna for his outstanding contribution to AI learning in India

[@yogeshyts]

PM bna dena chahiye

[@yumyum3876]

@@yogeshyts that works too

[@ashwinkumarh2422]

Worth the time... A good course covering overall most of the concepts...

[@teehueyyi883]

super nice and detail tutorial guide that found in youtube!!! finally i can usderstand where to get the API key and end point URL and a lot of anwsers for my questions for deploying genarative AI👍👍👍👍. Thanks you so much!!

[@jaychauhan2933]

Hi Krish, Thank you so much for sharing your knowledge through your videos. They have been incredibly helpful in my learning journey. I appreciate all the effort you put into them. I have a few questions that I believe will also benefit the community: Best Practices for Deployment: What are the best practices for deploying an open-source LLM (Large Language Model) to handle multiple requests from different users simultaneously? Handling Multiple Requests: How can I deploy an open-source LLM to efficiently handle many requests from different users at the same time? Reducing Response Time: What strategies can I use to reduce the response time of the deployed LLM? Accuracy with RAG Implementation: How can I check the accuracy of an LLM model when using Retrieval-Augmented Generation (RAG) implementation? Creating Instruction-Response Pairs: How can I convert raw text into instruction and response pairs for fine-tuning models like Mistral, LLaMA, or any other open-source model? I believe a video addressing these questions and providing solutions would be very helpful for the community. Thank you once again for your support and guidance. Best regards, Jay

[@mallikrao5662]

1.Best Practices for Deployment: Deploying a Large Language Model (LLM) in a production environment to handle multiple requests simultaneously requires careful planning. Here are some best practices: Load Balancing: Use a load balancer to distribute incoming requests across multiple instances of your model. This can help ensure that no single instance becomes a bottleneck. Scaling: Use auto-scaling to automatically adjust the number of model instances based on the load. This can help ensure that you have enough capacity to handle peaks in demand, while not wasting resources during quieter periods. Monitoring and Logging: Implement comprehensive monitoring and logging to track the performance of your model and to quickly identify and resolve any issues. 2.Handling Multiple Requests: To handle multiple requests efficiently, consider using asynchronous processing or queuing systems. This allows your service to accept a request, place it in a queue, and then process it when resources are available, rather than forcing each request to wait for the previous one to complete. 3.Reducing Response Time: To reduce response time, consider the following strategies: Optimization: Optimize your model for inference. This could involve techniques like quantization, pruning, or using a more efficient implementation of the model. Caching: Implement caching for common requests. If you notice that certain requests are made frequently, you can store the results in a cache and return them immediately on subsequent requests. 4.Accuracy with RAG Implementation: To check the accuracy of an LLM model when using Retrieval-Augmented Generation (RAG), you can use a validation set of data. Run the model on the validation data and compare the model's outputs to the actual outputs. You can then calculate accuracy metrics based on this comparison. 5.Creating Instruction-Response Pairs: To convert raw text into instruction and response pairs for fine-tuning models, you can use a script that processes the raw text and splits it into pairs. The specifics of this will depend on the format of your raw text and the requirements of the model you're using. Typically, you would use a natural language processing (NLP) library like NLTK or SpaCy to help with this.

[@maheshbhosale3306]

Thank you sunny and krish

[@EhsanIrshad]

Bht alaw...

[@sachin-sachdeva]

Very nice detailed session with great explanation.

[@ehtishamraza2623]

A perfect course which covered everything

[@kunallahiri]

Can we use azure for free ? just for the purpose of project development for a better resume. Please guide me if possible,I am a big fan of Krish's channel and his immnese contribution.thnks from thr core of my heart for teaching us ❤

[@i-code8000]

This is what I looking for for a long time. Thank you guys

[@aliensamv3997]

really ... me too

[@regilearn2138]

Hi Krish, I am a MERN full stack developer, from where what should i learn to become a fullstack AI developer to match with job market.

[@suvadipdutta3281]

First comment ..🎉 great work sunny Savita

[@arthurkatz8035]

Thanks Sunny and Krish =)

[@AbdulWahab-ld7cc]

Great Work...Thank you so much for providing such a worthy content..

[@ehtishamraza2623]

Thank you for this amazing resource

[@sajjadrahman256]

Who's target is complete within 3 days, hit like and share thoughts. I am learning

[@Momentum_Option_Buyer]

I am listening in one go and reiterate again topic by topic

[@AnushreeDarshane-l5m]

Thank you for detail session, covered all the points. Can you please also provide session on Copilot it will be really helpful.

[@shahrulamin5528]

❤ from Malaysia!!!! , never stop learning and always Day1

[@Ndbdbbdbdbh]

needed this for a project

[@crazydude8333]

Maximum log kya Sikh rahe hai currently development or AI ML ? Job kisme better hoga in future aspects

[@arundhatimishra8851]

What are the differences in approaches between creating a custom chatbot using a shoes PDF file and later applying a RAG architecture with the same document? Specifically, how are the document chunks stored in Azure Blob? Are they first converted into embedded and then stored? If a vector database isn’t used, how is the information retrieved? Could you please clarify these questions.

[@shaikansari6882]

Blob storage is to store your pdf file as a blob object in azure. Then this file will be read by azure service and it will divide the entire content present in the file as small chunks and then these chunks will be converted into embeddings and that will be stored in a database. That database is nothing but index which you are creating and to search the database you need a search capabilities right... That's called as Azure AI search service.

[@AkshatAgarwalpro]

@53:57 when the dark lights takes over xD

[@YouHaveToLoveMe]

It was scary

[@Naentrikakudapikalev]

Thanks krish , It helps us a lot :)

[@anshulsharma7950]

On point Knowledge ❤

[@supriyoroybanerjee6219]

Amazing

[@JOYEES1979]

Brilliant

[@moediakite895]

Liking the session🤙

[@Momentum_Option_Buyer]

I see you are first cerating a model via GUI and then coding to call them via api? Do we have to create a model first via GUI? I am thinking how to create infra and deploy automatically from one environment to another via scripts with nothing manual from the GUI?

[@Gamezone-kq5sx]

Please make video on Generative AI With Google Cloud Open AI Services Crash Course.Waiting

[@Teach_only_technology________]

Thanks for the help

[@jayantisingh1534]

Good work ❤

[@ashishpathak5394]

it shows that we can register with company ebsite or something when filling form to request acess to azure Open Ai service,

[@rakeshpanigrahi577]

OMG, so cool, Thanks a lot :)

[@Momentum_Option_Buyer]

Are you planning to upload Azure Gen AI created by you. You said you are going to work in parallel with AWS.

[@datatalkswithchandranshu2028]

We need more courses where we are integrqting open source llm models in hf/colab.

[@krishnaik06]

Already on the track to upload the videos

[@morrazzo4432]

Sir, can I apply for AI 900 certification after this course?

[@Momentum_Option_Buyer]

2:17:33 Azure AI studio is a framework like langchain?

[@victorakakpo8299]

Hey am here too!

[@ManishThread1]

How much is subscription cost for using Azure OpenAI in (INR) ?

[@jatinsaini7773]

Can we give images as an input from the user to this chatbot???

[@jaeen7665]

Not bad thus far.

[@Momentum_Option_Buyer]

Thank you I requested.

[@shreyaschhetri9434]

Sir asking you to create a video on Guardrails using Guardrails AI and Nemo Guardrails using Mistral or Llamma models

[@ManafMukred]

what should i do if i don't have a private email? I can't create MS Azure OpenAI :(

[@nptel1punith929]

it is asking for a company mail addresss for creating Azure open AI account , students cant have it , is there any other way sir?

[@ajay0909]

Azure Open AI has restricted their access, I am not getting any access with my regular Azure account.

[@adyt9494]

Shoes pdf not uploaded please

[@crazydude8333]

Fresher ko generative ai me job mil rahe hai?

[@anushrikadam8650]

Can you do one on Gcp ?

[@sunnysavita10]

will be uploaded soon.

[@skplk9221]

Please Sir Hindi ki playlist bhi bna do

[@badrinarayanans355]

1:06:54

[@KumR]

2.30

[@rishiraj2548]

🙏💯👍

[@Momentum_Option_Buyer]

2:34:17 and 2:36:13 - Where is it storing vectors or embeddings? Cosmos DB? There is no reference of Cosmos DB in RAG application built in this video?

[@sunnysavita10]

we are using Azure Blob Storage it gives the capability of vector search

[@Momentum_Option_Buyer]

@@sunnysavita10 Thanks. Is it using Integrated Vectorization?

[@sunnysavita10]

@@Momentum_Option_Buyer yup

[@PriyankaPanchal-k2o]

Good job . Howevr, its too lengthy and I felt lil bit the trainer was over acting and dragging... make It small nuggets so that it will be more interesting and to the point. It took just 5 mins for me to get the bigpicture from here ..kzbin.info/www/bejne/aYS1mWWkr7Nleq8 . No offense its my view point

[@anshumansinha5874]

Why do you post a cringe face on a thumbnail; is it just to annoy people? I just clicked on the video to say this.