Learning AI Deployments

  Рет қаралды 303

Fly․io

Fly․io

Күн бұрын

I've been learning how to deploy and augment LLM models using Fly.io's
GPUs. If you are building AI apps, here are five things I've learned
as I get more familiar with everything:
1. Every LLM model should be its own application
2. Don't allow the public to access your models.
3. Don't redownload your base models on every run.
4. Don't wipe your database.
5. Stop idle GPUs.
If you want to learn more about any of these topics, dig deeper a bit
into the tech, add a comment (or just say hi!)

Пікірлер: 1
@julianduque
@julianduque 4 ай бұрын
Mr Builes! Good to see you
Unlimited AI Agents running locally with Ollama & AnythingLLM
15:21
Tim Carambat
Рет қаралды 174 М.
The 8 AI Skills That Will Separate Winners From Losers in 2025
19:32
It’s all not real
00:15
V.A. show / Магика
Рет қаралды 20 МЛН
Mom Hack for Cooking Solo with a Little One! 🍳👶
00:15
5-Minute Crafts HOUSE
Рет қаралды 23 МЛН
黑天使被操控了#short #angel #clown
00:40
Super Beauty team
Рет қаралды 61 МЛН
Deploying an LLM-Powered Django App | Ollama + Fly GPUs
6:34
Fly․io
Рет қаралды 1,5 М.
Visualizing transformers and attention | Talk for TNG Big Tech Day '24
57:45
Building a Mobile Backend with N8N & AI Agent Tools
19:38
Alfred Nutile
Рет қаралды 522
How to Build Effective AI Agents (without the hype)
24:27
Dave Ebbelaar
Рет қаралды 48 М.
We built an orchestrator from scratch. Here's why.
7:21
Fly․io
Рет қаралды 15 М.
Expert Guide: Installing Ollama LLM with GPU on AWS in Just 10 Mins
10:14
Fast and Simple Development
Рет қаралды 10 М.
Prompt Engineering, RAG, and Fine-tuning: Benefits and When to Use
15:21
8 AI Tools I Wish I Tried Sooner
16:10
Futurepedia
Рет қаралды 312 М.
Local RAG using Ollama and Anything LLM
15:07
GovBotics
Рет қаралды 14 М.
It’s all not real
00:15
V.A. show / Магика
Рет қаралды 20 МЛН