Why you should use Edge Functions for AI

Edge Functions are perfect for encapsulating AI logic, but downloading these massive models on every invocation leads to significant load times, and a very large bill! In this video, Jon Meyers explains the benefits of Supabase attaching these models on disk.
✍️ AI Inference now available in Supabase Edge Functions: supabase.com/blog/ai-inferenc...
00:00 Don't Download AI Models in Edge Functions
00:24 Overview of AI Inference example
00:48 Create a vector embedding
02:08 Performing similarity search in Edge Function
03:06 Sending a HTTP request to search embeddings
03:41 This entire system running on LocalHost
🤖 AI Inference in Supabase Edge Functions example: github.com/supabase/supabase/...
💻 Videos to watch next:
▶ Supabase is now GA: • Supabase is now GA
▶ The missing pieces to your AI app (pgvector + RAG in prod): • The missing pieces to ...
▶ Fastest way to build a SaaS in 2024 - Next.js, Supabase and Stripe: • Fastest way to build a...
👇 Learn more about Supabase 👇
🕸 Website: supabase.com/
🏁 Get started: app.supabase.com/
📄 Docs: supabase.com/docs
🔔 Subscribe for more tutorials and feature updates from Supabase: / @supabase
📱 Connect with Us:
🐙 Github: github.com/supabase
💬 Discord: discord.supabase.com/
🐦 Twitter: / supabase
📸 Instagram (follow for memes): / supabasecom
ABOUT SUPABASE:
Supabase is the open source Firebase alternative. Supabase provides a full Postgres database for every project with pgvector, backups, realtime, and more. Add and manage email and password, passwordless, OAuth, and mobile logins to your project through a suite of identity providers and APIs.
Build in a weekend, scale to millions.
#Supabase #AppDevelopment #RealtimeApps #DeveloperTools

[@Supabase]

If you wanna go deeper, check out the blog 👇 AI Inference now available in Supabase Edge Functions: supabase.com/blog/ai-inferenc...

[@R0cky0]

This is bigger than the big announcement. Hat off!

[@JonMeyers]

A grown up GA company deserves a grown up DevRel 😆

[@wilsonwong753]

The hair! Nice 👍

[@JonMeyers]

Thanks! Not sure if I am going to keep it post GA week - we'll see!

[@ai_koshey_bot]

url argument is missing. Am I the only one who couldn't get it to work? It is not clear how the trigger was created.

[@_taishi]

dang jon your video is so good

[@zik2000]

does this work for bigger text fields? or just single word term? for example: say i have a 'description' column for movies. Will I be able to create a vector for that column so that when a user looks for example "life in simulation" it will probably return 'The Matrix' based of the description ?

[@MrMatDoe]

Hi there, I would really love for you guys to create a tutorial on how to delete a user using edge functions (having access to all the admin privileges, services role keys and stuff)

[@greendsnow]

Great, how does it scale?

[@lasifuta1573]

Please correct me if I am wrong, but at 1:10 I assume it should be Webhooks instead of Trigger as an edge function is needed?

[@JonMeyers]

It is both! Prob should have mentioned this in the video, but it is a Trigger than invokes a Webhook! 👍

[@yourpc]

how to fix "permission denied for schema public" in edge supabase?

[@kush.mikashita]

Do Embeddings work for other languages too? Like French for example.

[@Typnickman-]

In general yeah. Not sure about quality

[@Typnickman-]

Hi guys, i've updated supabase-js on deno to 2.42.2 but it still says "ReferenceError: Supabase is not defined"

[@JonMeyers]

Also try upgrading the Supabase CLI and creating a new function 👍

[@rahikumarbhagat7563]

you have to update supabase cli.

[@Typnickman-]

@@rahikumarbhagat7563 i'm using npx supabase@latest

[@mikejohneviota9293]

holysht 🎉🎉

[@JonMeyers]

I know, right?

[@dshukertjr]

A controvertial way of pronouncing tomato 🍅

[@JonMeyers]

Oh no! That's not even the bit that was meant to be controversial! 😆