Build A Full Stack Chatbot in Rust (feat. Leptos & Rustformers)

  Рет қаралды 163,897

Code to the Moon

Code to the Moon

Күн бұрын

Пікірлер: 222
@codetothemoon
@codetothemoon Ай бұрын
PSA Since this video was made, the Rustformers crate, which is used for interacting with language models, has been archived. You can still use Rustformers if you'd like to follow along directly with the video, but I'd recommend using an alternative if you can. Here are some alternative crates to consider, in roughly in ascending order by level of ML knowledge required by the consuming developer: Kalosm - floneum.com/kalosm/ Mistral rs - github.com/EricLBuehler/mistral.rs Candle - github.com/huggingface/candle/blob/main/candle-examples/examples/llama/main.rs
@hazadus
@hazadus Жыл бұрын
It's so cool you use Rust on backend and frontend the same time! Would be great to see more videos on using Rust to build full stack! And the bot itself is super fun!
@codetothemoon
@codetothemoon Жыл бұрын
nice, glad to hear this one worked for many folks - looks like I'll be making more!
@kameikojirou
@kameikojirou Жыл бұрын
@@codetothemoon Please do!
@yellowant7875
@yellowant7875 Жыл бұрын
Super interesting video! I love watching someone go trough a project small-ish but complete project. Would love to see more videos like this in future!
@ColinTimmins
@ColinTimmins Жыл бұрын
I’m just starting to code again. Last time I wrote code was in 1997 and was promptly discouraged as I am quite dyslexic. Not anymore with ChatGPT, holy heck has it been helpful for me! Watching projects from start to finish, and the methods for doing so is what I need to see and learn. =]
@codetothemoon
@codetothemoon Ай бұрын
Really happy you enjoyed it! Will definitely focus on making more like it!
@rosslovell73
@rosslovell73 Жыл бұрын
Your videos are some of the most timely, spot-on code tutorials available. It is as if I get an idea to do a project, and out of nowhere, you post a video showing me just exactly how to approach it. Really amazing stuff you produce.
@adicide9070
@adicide9070 Жыл бұрын
someone's got a crush... but is it maybe likely that folks are about building chatgpt clones now, perhaps? :)
@MrAweosmeJr
@MrAweosmeJr Жыл бұрын
@@adicide9070 bahaaha :D
@codetothemoon
@codetothemoon Ай бұрын
nice! thank you for the kind words, and glad it aligned with something you already had in mind to build!
@vikaspoddar001
@vikaspoddar001 Жыл бұрын
Rusty Bros... Get ready for another great ride
@codetothemoon
@codetothemoon Жыл бұрын
🚀
@NSA.
@NSA. Ай бұрын
K
@TobiasFrei
@TobiasFrei Жыл бұрын
Just too nice, two things I wanted to have a look at united: a Leptos example and how to access G. Gerganov's language models in Rust. So, thanks a lot! 🦀👍
@codetothemoon
@codetothemoon Жыл бұрын
thanks! glad you got something out of it!
@darksideishere
@darksideishere Жыл бұрын
Thanks for this! You always bring out quality content.
@codetothemoon
@codetothemoon Жыл бұрын
glad you got something out of it! 😎
@wesleychaffin4029
@wesleychaffin4029 11 ай бұрын
this is the most disgustingly insane thing I've seen in a while. I will be trying trying both the llm integration and the all rust NoJS stack immediately
@codetothemoon
@codetothemoon 11 ай бұрын
Great let us know how it goes! hoping to be able to build more stuff like this...
@emnul8583
@emnul8583 3 ай бұрын
Great video! I typically use these videos as reference when I'm building in Rust. Adding timestamps would be a 10x improvement for me!
@codetothemoon
@codetothemoon 2 ай бұрын
thanks, really happy you got value out of it! and thanks for the feedback!
@northicewind
@northicewind Жыл бұрын
That was the rustiest video I've seen in a while! Thank you! Keep up the good work. Really like the content and presentation. Also a bit of offtopic. I've noticed that you've switched from neovim to doom emacs several months ago. Maybe you can share your experience? I'd be very interested.
@codetothemoon
@codetothemoon Жыл бұрын
thanks for the kind words! my primary reason for switching to doom emacs is really org mode and org-roam, so I can take notes and manage knowledge in the same place I'm writing code. To me that's very valuable. I did made a video primarily about org mode ("Why I Prefer Emacs over vim") but I would like to do a more in depth comparison between doom emacs and a Neovim configuration framework like NvChad (which I've also been very impressed with)
@isaactorres1339
@isaactorres1339 Жыл бұрын
Trpc i think gives you the same functionality in JavaScript land for not having to write fetches manually and just calling a function name.
@Incertophile
@Incertophile Жыл бұрын
Can confirm I was able to get this working on my desktop. It's got a ryzen 5 so responses do take a bit longer, but just wanna say awesome guide and ty. Still trying to get my head around rust, and I don't use js/ts at all, so I just copied the tailwind stuff from the repo and it was fine. The rust error handler is such a joy. I just went step by step and fixed everything (I had lots of typos from typing by hand to get used to the syntax), and leptos built at the end just fine.
@pixelstriko1642
@pixelstriko1642 Жыл бұрын
Cool to see Doom Emacs! The Monokai themes are nice but I prefer the default Doom One theme.
@codetothemoon
@codetothemoon Жыл бұрын
I agree the default one is pretty good. it's fun to switch things up now and then, maybe I'll give it another shot
@-marin4332
@-marin4332 Жыл бұрын
Loved the video, please more Leptos!
@simp-
@simp- 2 ай бұрын
15:10 that pattern reminds me of how tRPC works while using Typescript
@codetothemoon
@codetothemoon 2 ай бұрын
Thanks, yeah I hadn't tried tRPC but a few others mentioned this as well! Good to know the pattern is available in the JavaScript ecosystem as well!
@seethruhead7119
@seethruhead7119 Жыл бұрын
server actions are what you're looking for at 14:00
@Blavion1004
@Blavion1004 Жыл бұрын
This is awesome. Can you release some content on how you got to the level of rust you are today? What projects do you think could elevate a novice??
@codetothemoon
@codetothemoon Жыл бұрын
thanks! Everything I've learned about Rust has come from making videos about it and doing little projects like the one in this video. But most of my knowledge of software development comes from my ~13 years in the industry prior to learning Rust 😎 As for projects that can elevate your skills, the best choice is always the project that you're most excited about. I don't think one specific type of project lends itself more to learning than another - I think for any given type of project there are are ways of approaching it that are more suited for a beginner and other approaches that an expert might take. Examples: make a game, make a webapp, create generative art, create a command line utility, etc. All of these are suitable for beginners and experts alike, though the approach might differ depending on the level of experience.
@danygagnon8446
@danygagnon8446 Жыл бұрын
What is your neovim plugin for the file manager? I've looked over to your github but I didn't find your dotfiles. Great video btw!
@danygagnon8446
@danygagnon8446 Жыл бұрын
Ah nvm you are using emacs
@codetothemoon
@codetothemoon Жыл бұрын
yep doom emacs! of which I'm a big fan
@gunstorm05
@gunstorm05 4 ай бұрын
The pattern you mentioned at 15:10 or so is very similar to the way things are done in PHP land via a package for the Laravel framework called Livewire. Essentially, two parts: A Livewire PHP component class, and a Blade (html templating engine) file that references it. So you might have class MyComponent extends Livewire { public string $someValue = "Test"; public function save() { // Do saving stuff here } } and then your HTML can just do stuff like and and you never have to write any of the transport logic.
@ejazahmed4609
@ejazahmed4609 Жыл бұрын
Great work as always! Love your teaching style. Any plans on paid courses?
@codetothemoon
@codetothemoon Жыл бұрын
thank you! I do have something along those lines in the works...
@HyperFocusMarshmallow
@HyperFocusMarshmallow Жыл бұрын
Super useful, thank you!
@codetothemoon
@codetothemoon Жыл бұрын
nice, really happy you got something out of it!
@RobertoMaurizzi
@RobertoMaurizzi Жыл бұрын
Exceptional example showing a lot of interesting and useful things/techs! Instant subscriber! :D The `[profile.dev.package.ggml-sys]` specifies to compile the listed dependency package (or all if you write `[profile.dev.package."*"]`) with optimization level 3, the same that's used when compiling with --release: that way the dependencies (that don't change often unlike our code under active development) can __run__ fast while our code will still __compile__ faster and have debug data
@codetothemoon
@codetothemoon Жыл бұрын
thank you, very happy to have you onboard! and thanks for clarifying the meaning of `[profile.dev.package.ggml-sys]`!
@Kazyek
@Kazyek Жыл бұрын
Great stuff! But `unwrap_or_else(|err| panic!(...))` looks a bit silly to me, considering the behavior of unwrap is to panic with the error message (and expect(...) to panic with a custom error message).
@dealloc
@dealloc 9 ай бұрын
Would be cool, if the LLM itself is streaming, to use a streaming HTTP call, updating the bot's message every time the client receives a chunk of the message. This is also what ChatGPT does-it's not just fancy effects! That way you could even halt the response while it's still running mid sentence as well.
@codetothemoon
@codetothemoon 7 ай бұрын
Funny you mention this - after the video I actually implemented what you’re describing using web sockets. It’s in the repository if you’d like to have a look 😎
@dealloc
@dealloc 7 ай бұрын
@@codetothemoon Yeah, that's cool! Though I specifially meant with Server-Sent Events since it's only a one-way streaming connection that is needed, and so there would not be a need for change of protocol nor the overhead of the WebSocket connection on the client. Though, WebSockets works too!
@codetothemoon
@codetothemoon 7 ай бұрын
yeah I can't remember why I went with WebSockets instead of Server-sent events. I think maybe to keep the conversation context handy for the next prompt from the user? which you could do without WebSockets but there wouldn't be a guarantee the next request will go to the same host. not sure.@@dealloc
@ryn4337
@ryn4337 Жыл бұрын
this is awesome!! excited to learn from this vid
@codetothemoon
@codetothemoon Жыл бұрын
nice! hope you get some value out of it!
@jeremywatt3800
@jeremywatt3800 Жыл бұрын
supabase and featherjs offer similar front/back integration for ease of dev… thanks for making this vid!!
@codetothemoon
@codetothemoon Жыл бұрын
ohh nice thanks for letting me know, I haven't used either of those - maybe I should check them out. Thanks for watching, glad you liked it!
@emrahyigit
@emrahyigit 7 ай бұрын
While there are robust web frameworks like React or Angular available for frontend development, it's worth considering Rust only for backend tasks to ensure high performance.
@jly_dev
@jly_dev 15 күн бұрын
Remix uses loaders to simplify (abstract away) endpoints that are used by the client
@egm5081
@egm5081 Жыл бұрын
hey, man thanks for this awesome video, I wanted to ask, which hardware specifications does your laptop has
@codetothemoon
@codetothemoon Жыл бұрын
thanks for watching! It's an M1 MacbookPro with an M1 Max and 32GB RAM
@duttaoindril
@duttaoindril Жыл бұрын
The Leptos Server Functions pattern is effectively TRPC
@codetothemoon
@codetothemoon Жыл бұрын
yeah I took a look quick look at TRPC - at first glance it appeared to be similar but not quite as concise as clean as what Leptos has. could be completely wrong about that - maybe I just need to do a deeper dive.
@lezzbmm
@lezzbmm 10 ай бұрын
15:00 honestly sounds a lot like some of the benefits u get from graphql but for a little less verbosity (depending on which gql libraries/frameworks u use)
@LightningMcCream
@LightningMcCream Жыл бұрын
I've got most of the leptos components working great but for some reason I can't seem to get Rustformers LLM tools to work with the LLM; I've snagged the same Vicuna model you linked. I've git cloned the entire repository, and I've tried targeting a single node from it, and I've tried targeting the directory that all the nodes live in Should I be zipping up the repo into a single file or what is the best way to connect the Rustformers/LLM tool to my actual LLM?
@codetothemoon
@codetothemoon Жыл бұрын
what do you mean by "targeting" in this context? Make sure to specify the path to the language model in the `.env` file in the root of the repository (by default it's set to the path on my system). More broadly, make sure you've followed all of the steps in the readme (I just updated it a bit yesterday) github.com/Me163/rusty_llama/blob/main/README.md
@cig8995
@cig8995 Жыл бұрын
Wow, great job!
@codetothemoon
@codetothemoon Жыл бұрын
thanks, glad you liked it!
@WhiteSponge
@WhiteSponge Жыл бұрын
Hey there! This's awesome! I have been wanting to do try full-stack Rust but for some reason I cannot get Leptos to deploy properly online. Locally everything works but when deployed to any host (e.g Github pages or AWS), it always shows an empty page LOL I do have my backend running in Rust though via Actix Web :D
@QuentinDurot
@QuentinDurot Жыл бұрын
Thank you for this, what is the plugin you're using to find your imports?
@alkeryn1700
@alkeryn1700 6 ай бұрын
you seem to be a lot into rust and so am i, however i've never used lisp much and i presume you did since you are a emacs user. what comparison of the two would you make in term of workflow ?
@juanlosauro
@juanlosauro 11 ай бұрын
Great job man! What font are you using in your editor?
@deathdefier45
@deathdefier45 6 ай бұрын
Would the wizard-vicuna-13B-GGML model work if I switched it out with the current model you are using? Amazing video by the way taught me all the stuff needed to bootstrap a fullstack Rust project, also thanks a ton for the bonus tailwindcss integration part haha
@opinionatedOG
@opinionatedOG Жыл бұрын
Idk if im doing something massively wrong but inference doesn't work for me. I think cpu bottleneck as the request doesn't complete at all. i have an older ryzen 5 but can i not use gpu for inference? i have a 3060ti.
@codetothemoon
@codetothemoon Жыл бұрын
I think there is a way to enable CUDA for inference (or Metal) but I hadn't looked into that yet prior to creating this video. Maybe hop on the Rustformers/llm Discord, I'm pretty sure CUDA is supported, and I'd think the 3060ti should be plenty to run Vicuna 7B
@Anipy-vu5cc
@Anipy-vu5cc 19 күн бұрын
Could you please also teach how to host/deploy this project on a live server? Thanks
@Bakobiibizo
@Bakobiibizo 4 ай бұрын
holy, spent like 3 hours trying to figure out why mine didnt compile. turns out future_utils is not futures_util. *eye roll* there should be a law about naming your libraries too close to another. lol
@wahnsnn7525
@wahnsnn7525 8 ай бұрын
Interesting tutorial! I will definitely give it a try. I have a question. Is it also possible to define your own applications, similar to OpenAi? Example: Can I link a specifications document (.pdf/.text file) and then make requests for it? And then the bot gives me an answer in the context of the document.
@codetothemoon
@codetothemoon 8 ай бұрын
thanks! what you're describing is absolutely possible, and there are a couple approaches you can take 1. If you're using a language model with a large context window, you might be able to simply prefix your prompt with the entire contents of the relevant documents 2. Implement RAG (Retrieval augmented generaton) yourself - where semantic search is done on the documents in question and the pieces deemed most relevant to the prompt are extracted and included in the prompt to the language model. There are databases that provide semantic search capability like Pinecone and Nuclia that can help with this
@kelvincesar_
@kelvincesar_ Жыл бұрын
I also had to install "npm install -g sass" to make "cargo leptos build" work
@codetothemoon
@codetothemoon Жыл бұрын
oh interesting thanks for pointing this out!
@kiyov09
@kiyov09 Жыл бұрын
Super awesome! ❤
@codetothemoon
@codetothemoon Жыл бұрын
thanks, glad you liked it!
@opinionatedOG
@opinionatedOG Жыл бұрын
correct me if im wrong, but i think you can call the backend functions in a similar way in the T3 stack can you not? Also really great video.
@cchance
@cchance Жыл бұрын
Trpc which is what t3 uses for that l, is about as close to serverfn as your gonna get as far as I know when doing client and server in typescript
@codetothemoon
@codetothemoon Жыл бұрын
never tried T3 myself, been hearing great things about it though. I may have to give it a spin!
@arcstur
@arcstur Жыл бұрын
I would like a Tailwind video! :D
@codetothemoon
@codetothemoon Жыл бұрын
nice thanks for the feedback! will try to make one...
@arcstur
@arcstur Жыл бұрын
@@codetothemoon nice!! It would be cool to see it integrated with Leptos. Thanks for all your work and for taking the time to answer me :))))
@NguyenTien-zl7mz
@NguyenTien-zl7mz Жыл бұрын
Nice! what theme you using in Emacs?
@codetothemoon
@codetothemoon Жыл бұрын
thanks! doom-monokai-pro
@NerdlFest
@NerdlFest Жыл бұрын
Quick question, if I wanted to enable CUDA support where would I do that (just kind of a general direction thing). I went to the docs for Rustformers and *attempted* to try their implementation, however that didn't seem to do anything. This may just be a matter of "git-gud" for doc reading.
@codetothemoon
@codetothemoon Жыл бұрын
I actually had the same question, but in my case pertaining to metal support. I found instructions on how to enable it for the Rustformers command line tool, so my next step was going to be looking at the code for that to see what it's doing under the hood. Wasn't able to get there prior to making this video unfortunately :/
@lukaskreussel669
@lukaskreussel669 Жыл бұрын
Good timing! I've just added CUDA/OpenCL support yesterday. Yeah, you're right, our docs on how to use GPU acceleration could use some work. I'll admit, documentation isn't really my strong suit.
@codetothemoon
@codetothemoon Жыл бұрын
@@lukaskreussel669 nice, thanks Lukas! Really appreciate your efforts!
@pixel7038
@pixel7038 2 ай бұрын
Is leptos or dioxus a single file component? I come from svelte and blazor and single file components are a lot cleaner from my experience
@codetothemoon
@codetothemoon 2 ай бұрын
by "single file component" do you mean SPA? if so then the answer is yes. If you really mean single file component, it's completely up to you as the developer whether you want files to be 1:1 with components
@hhoums
@hhoums 8 ай бұрын
N00b question: If I wanted to integrate such a chatbot into a website, what would be the best approach?😮
@codetothemoon
@codetothemoon 8 ай бұрын
It really depends on the nature of the website that you're looking to integrate it into. You could use this project as a starting point and built the rest of the application around it, or you could use this project as an example for building something similar into whatever tech stack your website currently uses.
@oopsieadam
@oopsieadam Жыл бұрын
i think the closest thing i can think of to this in the JS world is NextJS server actions which is still beta
@codetothemoon
@codetothemoon Жыл бұрын
nice, I may have to check those out!
@asdfjackal
@asdfjackal 10 ай бұрын
15:13 you might be looking for trpc? It kind of accomplishes the same thing.
@noviriustomeisho6630
@noviriustomeisho6630 Жыл бұрын
Some checkpoints in the video would help.
@alphabitserial
@alphabitserial 11 ай бұрын
Qwik has a pattern like Leptos's server APIs!
@conradogarciaberrotaran7160
@conradogarciaberrotaran7160 Жыл бұрын
This is awesome, thanks
@codetothemoon
@codetothemoon Жыл бұрын
nice, glad you got something out of it!
@MarcosVMSoares
@MarcosVMSoares Жыл бұрын
Why not liveview? And yes rust and elixir have liveview that can do SPA without JS(only for websocket) render everything at the the backend
@codetothemoon
@codetothemoon Жыл бұрын
I'd always been curious about this approach, and maybe it would be a better fit. it seems like it's well supported in the Elixir world - what do you think the best approach in Rust land would be? This crate? github.com/lunatic-solutions/submillisecond-live-view
@TheHellishFrog
@TheHellishFrog Жыл бұрын
I cannot compile the code on Windows 11 - both repository codes from the "video" branch and my hand-written variant gives the following error: error: linking with `link.exe` failed: exit code: 1120
@MrLdangelo
@MrLdangelo Жыл бұрын
Awesome tutorial!
@asiraky
@asiraky Жыл бұрын
tRPC does the typesafe server side api thing you want.
@codetothemoon
@codetothemoon Жыл бұрын
thanks - I took a look at tRPC and it looked close but not quite as clean as what Leptos gives you. I didn't spend too much time investigating though - maybe I just need to dig a little deeper
@christianf1480
@christianf1480 Жыл бұрын
Are you using leptos with stable or nightly rust ?
@codetothemoon
@codetothemoon Жыл бұрын
just took a quick look and it actually looks like I used nightly when I was making this video - that was a mistake, I had originally intended to use stable. Up until very recently, I believe Leptos required you to use nightly. However, the code in the GitHub repository does use stable, so take a look at that if you want to avoid nightly.
@christianf1480
@christianf1480 Жыл бұрын
@@codetothemoon If you read the leptos readme, it is explained that nightly permit to use a simpler syntax. But nightly should not be used in a long term project. Thank you for your very instructive video. By curiosity, I have tried to generate it on Windows, but Visual studio 17 compiler fail with the C code of Rust former llm. I will try on my Linux computer or with WSL.
@ViniciusAtaide-f9f
@ViniciusAtaide-f9f 10 ай бұрын
why did you use the loop inj 37:11?
@eliasp.2759
@eliasp.2759 Жыл бұрын
Great video!
@codetothemoon
@codetothemoon Жыл бұрын
thank you!
@DaviAreias
@DaviAreias Жыл бұрын
Yes, actix!
@codetothemoon
@codetothemoon Жыл бұрын
😎
@RustaceanCo
@RustaceanCo Жыл бұрын
F#/websharper has this function call inside of api call. i tought this is coolest thing I ever seen but, in time this abstraction is to much for mind. I prefer standard http api call with http client(fetch,axios etc). Also last few month using htmx with maud(server side html generator :P) make things easier and more hypermedia style.
@artursradionovs9543
@artursradionovs9543 Жыл бұрын
How to get a Tailwind CSS, for some reason it doesn't work on my end. And how to swap over Axum from Actix? Thank you
@codetothemoon
@codetothemoon Жыл бұрын
check out this example if you haven't already: github.com/leptos-rs/leptos/tree/main/examples/tailwind re: axum, I'm actually not sure as I've never actually done this. maybe check the Leptos docs and if it's not there, ask on their Discord server - Greg is very active on there answering questions!
@prashlovessamosa
@prashlovessamosa Жыл бұрын
Great Thanks for Sharing.
@codetothemoon
@codetothemoon Жыл бұрын
thanks for watching!
@WookENTP
@WookENTP Жыл бұрын
A link to your dotfiles please :) specifically vim, that's some awesome status line!
@codetothemoon
@codetothemoon Жыл бұрын
it's actually doom emacs! theme is doom-monokai-pro. other than that, everything else is pretty much what you get out of the box.
@WookENTP
@WookENTP Жыл бұрын
@@codetothemoon I haven't noticed the window title :facepalm: Thanks :) Great content (regardless of the inferior editor preference).
@M0dr0
@M0dr0 Жыл бұрын
Guys, why am I getting error: linking with cc failed exit status 1 when I run cargo leptos watch...
@zatochiSiberian
@zatochiSiberian 9 ай бұрын
Wow. Thanks.
@codetothemoon
@codetothemoon 9 ай бұрын
glad you got something out of it!
@jaymarksum6542
@jaymarksum6542 Жыл бұрын
Great video! What window manager do you use?
@codetothemoon
@codetothemoon Жыл бұрын
thank you! I use Amethyst - I think it's fantastic, but it's also the only window manager I've really used for more than a trivial amount of time 😎
@guisoliven8022
@guisoliven8022 Жыл бұрын
​@@codetothemoon what is the code editor? thanks
@codetothemoon
@codetothemoon Жыл бұрын
@@guisoliven8022 doom emacs 😎
@charlesm2600
@charlesm2600 Жыл бұрын
Thanks!
@codetothemoon
@codetothemoon Жыл бұрын
thank you thank you so much for the support!
@pedrosaraiva1930
@pedrosaraiva1930 Жыл бұрын
It's possible to use this lib to load personal documents and query them?
@codetothemoon
@codetothemoon Жыл бұрын
this is achievable but not without a bit of effort. the biggest obstacle there is the limited input size of the models, so in most cases you can't just prefix your prompts with the entirety of the documents. Many work around this by doing a semantic search on the document base to prune out the parts most relevant to the prompt, then prepend those excerpts to the prompt that is given to the language model. The problem with this approach is that there isn't a guarantee that the semantic search will surface all of the context necessary to accurately respond to the prompt.
@ItzBreakfast
@ItzBreakfast Жыл бұрын
How about dioxus?
@codetothemoon
@codetothemoon Жыл бұрын
it's extremely high on my list of stuff to check out!
@codetothemoon
@codetothemoon Жыл бұрын
Join us on Discord discord.gg/2G35Sp6kpQ
@climatechangedoesntbargain9140
@climatechangedoesntbargain9140 Жыл бұрын
Does it have a bridge to Matrix?
@guisoliven8022
@guisoliven8022 Жыл бұрын
what code editor do you use. not like neovim, thanks
@codetothemoon
@codetothemoon Жыл бұрын
doom emacs!
@guisoliven8022
@guisoliven8022 Жыл бұрын
@@codetothemoon thanks
@chloefourte3413
@chloefourte3413 8 ай бұрын
Thanks!!
@codetothemoon
@codetothemoon 8 ай бұрын
thanks for watching!
@Sahil-cb6im
@Sahil-cb6im Жыл бұрын
can you do a video that, which areas rust is helpfull in using in react app like that.
@codetothemoon
@codetothemoon Жыл бұрын
you're asking what the advantages of using Rust on the frontend are? Type safety guarantees (because TypeScript is a superset of JavaScript, it can't really do such a thing), no garbage collection which yields better performance for certain use cases. Language isomorphism for projects where the backend is also in Rust (such as this one). Basically any reason you'd prefer using Rust over some compile-to-js language on the backend would likely apply to the frontend as well.
@chickenchoclates1971
@chickenchoclates1971 9 ай бұрын
I think the project is a bit high level for me for now, will need to learn th rust syntax and come back.
@kinositajona
@kinositajona Жыл бұрын
Very easy to understand! I still didn't understand the whole node_ref thing. Why is that necessary?
@cchance
@cchance Жыл бұрын
Noderefs allow you to pass a reference to a specific dom node around to say a function or closure, that way the closure can make changes and do things to the dom node and you don’t have to try to inline the statements as part of the dom
@dr.med.janschiefer7163
@dr.med.janschiefer7163 Жыл бұрын
Danke!
@codetothemoon
@codetothemoon Жыл бұрын
thank you so much for the support!!! 🙏
@raulvictortrombin6776
@raulvictortrombin6776 Жыл бұрын
Is it possible to train this LLM to use some own database/documents?
@raulvictortrombin6776
@raulvictortrombin6776 Жыл бұрын
Nice content! thks for share
@codetothemoon
@codetothemoon Жыл бұрын
this is kind of something I'm actively researching. Fine tuning using your own documents is an option, but I don't believe Rustformers supports this so you'd have to use a different library and I'm not sure how effective it is. The other option is the "few-shot" approach, where you provide your documents inline with your prompts - this is an easier and more effective approach as long as your documents fit in the context length of the model, but that can very quickly become limiting. To overcome the context length limitation, another option is to put your documents in a vector database and use semantic search to find the parts most relevant for a particular prompt, then feed just those pieces into the prompt that goes to the LLM. I think this is currently the most common pattern for this use case - check out something like NucliaDB (open source), Pinecone (not open source), or Weaviate (open source)
@varshneydevansh
@varshneydevansh Жыл бұрын
you got a sub
@codetothemoon
@codetothemoon Жыл бұрын
nice! very happy to have you onboard!
@ajays6393
@ajays6393 6 ай бұрын
Now create_action needs to take a function which returns a future
@abubakaramjad3343
@abubakaramjad3343 Жыл бұрын
error occurred: Failed to find tool. Is `gcc.exe` installed?
@codetothemoon
@codetothemoon Жыл бұрын
yikes - I don't have any experience building this on Windows, is that what you're on?
@abubakaramjad3343
@abubakaramjad3343 Жыл бұрын
@@codetothemoon Yes
@Dimkar3000
@Dimkar3000 Жыл бұрын
trpc implment a similar pattern for api requests
@questionareprogresso7746
@questionareprogresso7746 11 ай бұрын
I just do a insta like when I see a video about rust with more than 10min.
@Redyf
@Redyf Жыл бұрын
What font is that?
@codetothemoon
@codetothemoon Жыл бұрын
I think it was likely Fira Code, if not it would be Monaco. I made the switch from the latter to the former around the time of this video
@funnynews341
@funnynews341 Жыл бұрын
i'm a big fan of svelte, so poor to hear it slower than vue and leptos???
@codetothemoon
@codetothemoon Жыл бұрын
I'm a huge fan of Svelte as well! Incredible framework. I took a cursory glance at krausest.github.io/js-framework-benchmark/2023/table_chrome_114.0.5735.90.html and I'd personally describe the performance difference between it, Leptos and Vue as negligible at the moment. I definitely wouldn't switch from Svelte to Leptos for the performance - it'd be for the ability to use Rust on the frontend.
@Script_Alchemist
@Script_Alchemist Жыл бұрын
I hate my NixOS right now. I can't figure out how to get cargo-leptos to install. I'd probably already have it done with ubuntu or similar
@Script_Alchemist
@Script_Alchemist Жыл бұрын
I posted this. Right when I figured out the build. Hallelujah!
@codetothemoon
@codetothemoon Жыл бұрын
nice glad you got it sorted out!
@Script_Alchemist
@Script_Alchemist Жыл бұрын
@@codetothemoon gotta love a 45 minutes video turns into a 4 hour setup 😅. It's all good though. At least I learned how to get past it for next time.
@Script_Alchemist
@Script_Alchemist Жыл бұрын
@@codetothemoon Update. I never got it to work. I'm having a can't find cc error and it's a bit of a pain to figure out on NixOS to the point I needed to stop. I was getting the model loaded and everything on the build I did. Unfortunately I couldn't get my version or your version. Working. Yours less than mine. Thanks for the video anyway. I'll have to come back later and try again sometime.
@codetothemoon
@codetothemoon Жыл бұрын
@@Script_Alchemist can you paste the exact error you're getting? or hop on the Discord and I can try to help there! discord.gg/2G35Sp6kpQ
@aryantirkey1744
@aryantirkey1744 8 ай бұрын
Is rust good to learn vs go
@codetothemoon
@codetothemoon 8 ай бұрын
Really depends heavily on both what you enjoy working on and your personal taste in programming languages
@kaidev0711
@kaidev0711 Жыл бұрын
use theme in video ?
@codetothemoon
@codetothemoon Жыл бұрын
doom-monokai-pro!
@randomdude5634
@randomdude5634 5 ай бұрын
oo which font do you use!?
@780Chris
@780Chris 4 ай бұрын
Monaco
@randomdude5634
@randomdude5634 4 ай бұрын
@@780Chris thanks :D
@2Ditto
@2Ditto Жыл бұрын
i think trpc is similar but not completely
@codetothemoon
@codetothemoon Жыл бұрын
yeah that was my impression as well - it seems like it aims to automatically manage the contract between the client and server, but just a quick glance at the examples led me to believe that it wasn't quite as clean as what Leptos offers. I may need to do a deeper dive to see whether that is actually true...
@miriyalajeevankumar5449
@miriyalajeevankumar5449 8 ай бұрын
Great
@codetothemoon
@codetothemoon 8 ай бұрын
thank you, glad you got something out of it!
@miriyalajeevankumar5449
@miriyalajeevankumar5449 8 ай бұрын
It was really a great learning@@codetothemoon
@jialx
@jialx Жыл бұрын
I don't think you're going to have any FE perf issues for what your building haha " An input field, button and some message box's
@codetothemoon
@codetothemoon Жыл бұрын
The bottleneck is the language model inference, which uses a non trivial amount of compute power. By “relatively fast” on the MBP, I’m talking about 10 full seconds or so
@jialx
@jialx Жыл бұрын
@@codetothemoon The LLM for sure! I just meant when you where talking about different FE framework pros / cons 🚀
@mikejamesbelanger
@mikejamesbelanger Жыл бұрын
Yeah this is a great video, but I also don't see the relevance of showing that FE performance chart here, That said, the video does go on to explain the other advantages to using a rust-based FE framework, including sharing type definitions across FE/BE, and that cool leptos feature where the FE can automatically (via macros, I think?) invoke a BE function to trigger an HTTP request.
@codetothemoon
@codetothemoon Жыл бұрын
@@mikejamesbelanger the main reason is that until recently, Rust frontend frameworks had performance profiles that were inferior to most of the popular JavaScript frameworks, so it was often cited as a good reason not to use Rust on the frontend. With these numbers it seems like that can't really be used as a reason anymore.
@mikejamesbelanger
@mikejamesbelanger Жыл бұрын
@@codetothemoon Oh I see. Fair enough.
@bibliusz777
@bibliusz777 Жыл бұрын
I prefer warp and Elm (elm-ui)
@cdellio
@cdellio Жыл бұрын
Doom Emacs
@codetothemoon
@codetothemoon Жыл бұрын
much
@erbolatzh8633
@erbolatzh8633 Жыл бұрын
смотрю через перевод нейросетью, классно
@CoderJohnny
@CoderJohnny Жыл бұрын
7:24 I think naming things is nobody’s forte 😅
@codetothemoon
@codetothemoon Жыл бұрын
hah thanks, glad I'm not the only one! 😎
@seand7603
@seand7603 2 ай бұрын
Oooooooh what's this :)
@codetothemoon
@codetothemoon 2 ай бұрын
A full stack rust chatbot!! 🎉
Rust full stack web frameworks have a bright future
8:02
Code to the Moon
Рет қаралды 81 М.
Rust Demystified 🪄 Simplifying The Toughest Parts
14:05
Code to the Moon
Рет қаралды 185 М.
VAMPIRE DESTROYED GIRL???? 😱
00:56
INO
Рет қаралды 8 МЛН
🕊️Valera🕊️
00:34
DO$HIK
Рет қаралды 10 МЛН
didn't manage to catch the ball #tiktok
00:19
Анастасия Тарасова
Рет қаралды 33 МЛН
Synyptas 4 | Арамызда бір сатқын бар ! | 4 Bolim
17:24
How is this Website so fast!?
13:39
Wes Bos
Рет қаралды 447 М.
I spent six months rewriting everything in Rust
15:11
chris biscardi
Рет қаралды 434 М.
Dioxus vs Leptos  | Rust GUI Wars #2
21:18
Creative Coders
Рет қаралды 6 М.
Rust Powered Polymorphism ⚡️ With Traits
9:55
Code to the Moon
Рет қаралды 101 М.
Nix explained from the ground up
23:39
Surma
Рет қаралды 46 М.
Every Developer Needs a Raspberry Pi
27:27
Sam Meech-Ward
Рет қаралды 762 М.
Where is Rust being used?
11:46
Let's Get Rusty
Рет қаралды 105 М.
You don't need a frontend framework
15:45
Andrew Schmelyun
Рет қаралды 129 М.
VAMPIRE DESTROYED GIRL???? 😱
00:56
INO
Рет қаралды 8 МЛН