All about AI Toolkit for Visual Studio Code | Studio19

John Lam demos how the AI Toolkit helps you acquire, run, prompt, fine-tune and deploy large language models directly from VS Code. Learn more about the extension, what's next on the roadmap, and how to get started.
𝗦𝗽𝗲𝗮𝗸𝗲𝗿𝘀:
John Lam
𝗦𝗲𝘀𝘀𝗶𝗼𝗻 𝗜𝗻𝗳𝗼𝗿𝗺𝗮𝘁𝗶𝗼𝗻:
This video is one of many sessions delivered for the Microsoft Build 2024 event. View the full session schedule and learn more about Microsoft Build at build.microsof...
Studio19 | English (US) | Other
#MSBuild

[@djpirra]

Would be great to have a demo on how you fine tune it and how you deploy it for inference

[@FarzanaBanu-li8yo]

Where is the link in the description

[@thienanhnguyenbui]

Checked. I have installed AI Toolkit for VS Code

[@JaredWoodruff]

Looks awesome! Any plans for Visual Studio 2022 support? 🙂

[@stevehoff]

Visual Studio is the new Silverlite.

[@samithorozco]

great!

[@neuralhero]

Where is a Mac OS version?

[@b.c.2177]

Would be nice you to create some external NPU, for example, USB, or Thunderbolt 4 because most people don't have necessary hardware for local AI and to buy a new computer is tricky

[@AdamsTaiwan]

I want to run a SLM locally and have it trained on all the source code I have ever written. Then I want it to help me fix the problems and make it better. I don't want to use github copilot because I got some security sensitive data. I have tried LM Studio, but so far it's still copy/paste stuff... too much trouble.

[@sprintwithcarlos]

It's like ollama, isn't it?

[@googletjanster2917]

Seems like it

[@fahdmirza]

I did a video on how to fine-tune a model with AI Toolkit in VS Code here kzbin.info/www/bejne/mGOWnoR7fbuZa7c . Thanks.

[@aldoyh]

As long as there is No MacOS Version. It did Not Happen.