Something is wrong here. I have a 4070ti Super 16gb , a 7950X and 32gb of DDR5 6400 and 14b runs loads quicker . In task manager it says (for 8b) it uses 8gb of 16gb vram and with 14b it seems to use 11-13gb of vram and allocates an extra 16gb of actual ram of which i've not seen it use more than 0.2gb. Using latest Studio drivers and have CUDA toolkit installed. Edit, uploaded the Strawberry question on my own machine on my channel (might take a while to appear).
@sealone77713 сағат бұрын
Install dual OS with Linux. Hopefully you get better result
@abbcc55514 сағат бұрын
That's very fast and that totally was a dad joke
@davout577515 сағат бұрын
I tried the 8B models for Llama 3.1 and DeepSeek. I wanted a calculator and the Llama did an exceptional calculator. Easy to use, it allowed me multiple calculations until I told it to stop while the deepseek took way longer, printed a code that didn't even work and I needed to tell it that is didn't work. This is exceptionally bad for such simple task that even 3B models probably even smaller can do a calculator. When it did the calculator it was hard to use with multiple steps and shut down the program after I got the answer. Really not great at all. The whole hype is around the big model that is roughly comparable to models much smaller than it.
@samwebber310915 сағат бұрын
it’s crazy to me watching that people actually seem to think china’s like gonna win the race now just from this one model that our latest unreleased one is already far past, headlines still have a huge grip on everyone including investors
@Caricanalisis16 сағат бұрын
mhh in my 3060 it runs at the same speed
@JohnMcclaned20 сағат бұрын
anything less than the biggest model is a meme. the hype is about open source and quality parity. not about trying to run it on a crusty 4080.
@lipin00721 сағат бұрын
Did you lose money on Nvidia stock?
@peetungКүн бұрын
I heard it cannot say anything bad about China or CCP. Can you maybe ask it something like whether China has ever oppressed its own people historically?
@JJRWhislerКүн бұрын
Dave's Garage just posted a video, and he said the offline version accurately named the Tianamen Square photo and the censorship issues surrounding it. However, the online line version may give a different response.
@xiaoxingcheng684121 сағат бұрын
I guess the answer is no?😂 By the way you should search for real documentary on 8964, because seems to me westerner media is the one who has been lying
@michaelnjensen19 сағат бұрын
Is that really relevant for 99,99999% of use cases? Personally I would only use it for coding and reasoning, which wouldn't really be affected at all, I'm getting a lot more content filters and blocked requests on ChatGPT than this. (for completely non-controversial coding related tasks, that are clearly mismatches from the overly aggressive content filters on ChatGPT).
@1MinuteFlipDocКүн бұрын
i ran the 32GB version using LM Studio. it was better than this, but i didn't love it. the full model thru the deepseek website is pretty solid however.
@bojanradosavljevic1442Күн бұрын
Please try LM Studio instead ollama.
@Janman81Күн бұрын
It's funny the stock market thinks this will lower demand for GPU's while a 4080 doesn't even have the compute to count the r's in strawberry, not to mention training the model in the first place.
@taterrheadКүн бұрын
it's moreso that the market for like 2.5 years has priced NVIDIA as if there would never be any competition and the demand for their chips would at least increase linearly forever
@minininja5505Күн бұрын
it works well and fast with the same model foe your two questions in China
@coorsleftfieldКүн бұрын
My base model M4 Mac mini is doing these tasks way faster than your 4080..
@realchrishawkesКүн бұрын
I’ll try shutting down everything
@1MinuteFlipDocКүн бұрын
i've got the 64GB M4 mini. it runs this well! LOL
@dealloc18 сағат бұрын
My basemodel M1 Pro (16 GB) did this faster as well (yes the 14b one). It also came with the right answer, although the wrong order of the last 2 r's.
@BarringtonRobinsonII12 сағат бұрын
My lesser spec pc is faster than his, he has an issue somewhere. I have an M4 Mini with 24gb ram , 512gb ssd, 10 core etc etc and my 4070ti Super Ryzen PC rips it a new one on 14b.
@talzanderКүн бұрын
They wanted to liquidate nvidia and needed an excuse
@historichacker2013Күн бұрын
you realise there is a 671b model as-well?
@realchrishawkesКүн бұрын
Thanks for pointing that out. I’m aware but was hoping for something that runs locally that is near as helpful as chat-gpt
@RolandTannousКүн бұрын
@@realchrishawkes These are distills. Distills aren't the same thing as the model. Also: chatgpt is a 200b parameter model while this distill is 14b.
@ozgurdenizcelik16 сағат бұрын
Dude no one is able to run 671b model on locally.
@davout577515 сағат бұрын
That almost nobody can use locally.
@notuxnobux15 сағат бұрын
@@ozgurdenizcelik I saw somebody doing that. He only had to use 1tb ram (using it with llama.cpp to run it on cpu).
@Kimo.Codess11 күн бұрын
If you were to do this project in 2025 would your choice still be the same?
@TheWeepingCrayngel13 күн бұрын
Hey Chris. Meant to tell you RIP Bayside. Lost my pup last year as well and got a little cattle dog to carry on the flame. I’ve transitioned to cyber security (still in RVA) and have to put in that extra effort to make sure my man is getting all of his energy out lol. Stay safe brother.
@marcelplch872520 күн бұрын
A C guy here. I have to say this is a very excellent explanation. I feel like anyone talking about C is not doing enough disclaimers "I'm getting lost here/there.", but you put it excellently in just one simple "I'm not much of a C guy.", the best part is I don't even feel like it was needed at all. The IT field needs more people like you. That is "I don't have to understand EVERYTHING, but nor should I act like I know my tools are best for any job."
@richardrich166723 күн бұрын
Linode is a shit show they started with Akamai shit heads.
@NullViewer27 күн бұрын
Great for developers, bad for user browser!
@corepunchАй бұрын
Anyone here who still uses C/C++ for work? Among them those who wish they hadn't? I'll the the first
@IamJustin-tk6wzАй бұрын
I have worked with several of this editors. Ckeditor, quil.. They are all not good. If its easy to implement, its lacking in some features. It it has the features it lacks documentation and has tonns of issues. This things are all a mess
@yi.bunyongАй бұрын
ahhh
@gillesashley9314Ай бұрын
Bro just hit the "Apply All" button. Come on.
@danielkirsch4351Ай бұрын
Hi Chris, so 4 years later how do you feel about nestjs, would you still recommend it and are you still running your site on it?
@MrMaksuzАй бұрын
Chris, did u ever think about other career? What would be your number2 and numer3 picks after programming? Cheers (video please)
@kaihusravnajmiddinov5413Ай бұрын
Python sucks.
@mind6861Ай бұрын
Bro just press the damn apply button
@gillesashley9314Ай бұрын
Was telling myself samething.
@arab-csАй бұрын
Thank you
@PankajDohareyАй бұрын
One more thing i noticed is that it outputs much better Ruby or JS code than Python, perhaps it is a function of what code it has read during training. And one thing is for sure Ruby devs have some nice Software engineering practices in the community compared to python. In python community shoving all the ugly code you have produced in a class is the limit of software engineering they know. So much of python code in the wild is just bunch of functions in a file, each function doing 5-8 things, as if no concept of SOLID exists in Python community.
@PankajDohareyАй бұрын
It can go very fast and belt out code but doesnt think through all the variables. In which case you have to think through all the problems, have the forethought , then craft a well thought out prompt tehn it executes well on that. So a glorified Junior developer!
@taterrheadАй бұрын
where AI has been very unhelpful / extra-time consuming are things such as deploying projects to multiple platforms (ElectronJS builds/deploys for example) or annoying Dev Ops type work such as intricate Azure issues
@LukeAvedonАй бұрын
So far I haven't found Cursor worth it. Just using Claude or ChatGPT as a rubber ducky has been the most helpful. I already have vim set up like cursor if I want it but I almost never use it.
@joshua_chris_ofurunnaАй бұрын
0:58 Yeah
@juanpablosyoutubeАй бұрын
Thank you for always bringing that sobriety and straightforwardness to things in the industry. It's especially useful for new people going into the field when getting filled with all sort of information and on top having douchebags like him around confusing more and giving a stumbling block on people .. 👍🏽💪🏽
@Alex-pg1gtАй бұрын
Mattermost
@realchrishawkesАй бұрын
I’ve never heard of that. Thanks for sharing.
@entropy9735Ай бұрын
While I think image/video AI generation is cool, it's definitely not even a fraction as cool as LLMs to me
@MrMaksuzАй бұрын
Slack!!!!
@charlie64x2Ай бұрын
Slack, hands down. Teams is an abomination, something that should've never existed.
@realchrishawkesАй бұрын
Thanks for commenting!
@1MinuteFlipDocАй бұрын
my group uses Teams. it's ok. I do like the huge storage limits to create a channel and upload artifacts to it.
@realchrishawkesАй бұрын
Forgot to mention that one drive account
@mr.incredible8080Ай бұрын
Teams sucks. Slack is great. But companies use Teams because it’s free
@realchrishawkesАй бұрын
Thanks for commenting!
@googleiscreepynanya5926Ай бұрын
Teams is horrible
@realchrishawkesАй бұрын
Thanks for commenting!
@googleiscreepynanya5926Ай бұрын
@ you’re welcome!
@АндрійБорбуновАй бұрын
Discord is usable thing, Slack is.bulshit, Teams - in the same.bullshit.league
@realchrishawkesАй бұрын
I sometimes find it hard to search discord for help. A lot of game developers use it for unreal engine.
@astraton2001Ай бұрын
Actually both systems suck. I have to work with both and everyday I'm praying someone finally brings out a new system which is userfriendly, easy to understand, has a good search function for archived data, works offline if necessary, doesn't crash, has a fair price.
@realchrishawkesАй бұрын
Maybe AI will bring something new along
@aarony.7200Ай бұрын
Teams sucks. Performs horribly, tons of bugs, disorganized chats... the list goes on.
@randomrandom3985Ай бұрын
are you talking about Microsoft ?
@aarony.7200Ай бұрын
@randomrandom3985 yeah Microsoft Teams
@randomrandom3985Ай бұрын
@@aarony.7200 how do you plan to do that ?
@realchrishawkesАй бұрын
Crashes once a day. I love when the buttons become unresponsive in the middle of a meeting.
@dirtydevoteeАй бұрын
Reading the title "...Without the Hype" and then hearing the video start "...we've all been waiting for." is a bad sign. I don't trust any company whose CEO has no idea what the SHIFT key does on his keyboard. Notice at 0:55 he quickly removes the horrible looking video so you don't get a good look at what a scam this is. Jellyfish don't run. This "real review" of Sora ends with "I'm not really sure what to think to be honest." You are killing me, bro.
@realchrishawkesАй бұрын
Not sure what you’re talking about.
@DavorMagdicАй бұрын
I'm in stiches! "I asked for three little pigs, we got two." You're too patient with this nonsense, as if, we are two thirds of the way there, whereas this story is meaningless without all three. This is the most epic waste in the history of mankind. (Text much less so, it's a better google and i'm glad to pay for the Plus.)
@realchrishawkesАй бұрын
I was trying to be positive :)
@jusblaze99Ай бұрын
Dude u are such a HATER lol. A year from now JUST LIKE WITH GPT, which u also trashed HARD at first, you'll be using an updated version of this probably fairly often.
@realchrishawkesАй бұрын
We will see.
@sausytimeАй бұрын
Good demonstraition for why I actively avoid AI tools at least for now. I feel the overhyping and extreme use of these tools have overshadowed the limits we currently have and I struggle to find many use cases outside a short niche list such as stock footage and short promotional videos.