Code Like a Pro: Setting Up Model Llama-3-70B as Your VS Code Copilot

In this video, I will walk you step-by-step through the process of integrating the Model Llama-3-70B into your VS Code environment.
The video starts with an introduction to the Groq platform. We dive deep into the Groq offering and its playground. Then I show how to configure the API in the VS Code Continue extension.
With its advanced AI capabilities, the Meta's Llama-3-70B acts as your trusted companion, offering intelligent suggestions, code completions, and even debugging assistance, making your coding journey smoother and more efficient than ever before.
This video aims at supercharging your developer productivity.
Links mentioned in the video:
Video on configuring VS Code and Continue Extension: • Using ollama and phi3 ...
Configuring Continue using the OpenAI specications: docs.continue.dev/reference/M...
groq: www.groq.com/
groq playground: console.groq.com/playground
groq initial offering: wow.groq.com/
If this video has provided value or assistance to you in any way, I would greatly appreciate your support. Your gesture of buying me a coffee would mean a lot and help fuel further content creation. Thank you for considering it! www.buymeacoffee.com/saurabhjain
0:00 Introduction
01:00 Groq overview
7:54 Configure Continue extension to use groq llama
10:44 Demo to generate code
11:36 Conclusion

[@ranjaniitr]

This is basically recommended for faster llm token inference to be used in ai playground😊

[@trustn01]

thx for this video and free usage of 70b. but it looks like, that CodeQwen1.5-7B-Chat is outperforming Llama3-70B-instruct so u can use local llm?

[@saurabhkankriya]

It's completely your call. The purpose of the demo is to show that one can replace openai models with the open source ones.

[@trustn01]

@@saurabhkankriya Yes, of course, thanks so much for the demo. just thought share some other options if anyone is interested

[@AmitDas-yb3re]

How can you do this in Jetbrains IDE?

[@saurabhkankriya]

I don't have experience with Jetbrains. You can read the continue extension's github Readme. They probably may have a documentation on this kind of integration.

[@utkarsh8719]

Revoke your api key

[@saurabhkankriya]

Thanks for pointing this out. After recording the video, I deleted the API keys.