Go to l.linqto.com/anastasiintech and use my promo code ANASTASI500 during checkout to save $500 on your first investment with Linqto
@Zero-oq1jk6 ай бұрын
You said before we will get RISC-V. Will we? I mean Consumer PC.
@langhans1566 ай бұрын
Cerebras is not! outperforming Moore's law. Moore's law states that the density of transistors will double every few years. In what way does the Cerebras chip outperform other chips according to this metric?
@JakeWitmer6 ай бұрын
Please forgive me if you have already covered carbon nanotube bundle memory from Nantero, or nanodomain progress from Xyvex. If you have not covered extending Moore's law using Kurzweil's favored paradigm (nanotube arrays / "pistons"), could you? They might be able to store "state" without using energy or magnetism, but physical position read by lasers, for speed and resilience (MRIs + implants = safe). I know this is more theoretical than your recent videos, but Nantero did have a functional product... I apologize in advance if you've covered this already. Your channel is amazing! Thank you for the wonderful updates!
@clarkwallcraft27416 ай бұрын
@AnastasilnTech would you consider sharing your investment portfolio? I am very new at doing my own investments and I would be very interested in which startups you like. Doesn't have to be $ amounts and I will not consider your words as investment advice, "disclaimer".
@hdcomputerkeith6 ай бұрын
I GPU mine and rent them out to ai or POUW like FLUX for renting. I avoided the 4090s but getting ready to buy the 5090. I hated the heat that vram ddr6x puts out , so i hope the drr7 vram fixed that heat issue. I own 20 evga 3070 drr6 gpus . SO ya lets go 5090 GPUs! Before xmas
@RonLWilson6 ай бұрын
Way back when I was getting my BSEE in the 70's I always loved analog computers and am glad to see them now making a comeback!
@kristas-not6 ай бұрын
how many modern ee or cs majors understands what an operational amplifier (op-amp) is or even realizes what the ”op” really meant?
@k-c6 ай бұрын
Analogue technology is way too underrated. Incredible knowledge has been lost.
@kristas-not6 ай бұрын
@@monad_tcp those *are* digital, but there's a *lot* of talk/chatter about analog ai chips and analog neuromorphic chips.
@igorkogan91386 ай бұрын
Hi Anastasia. Congrats! Another “huge” podcast. You are the only KZbinr uniquely qualified to bring the latest innovations in AI/processor technologies. I’ve been retired now for two years, after spending 40 years as a semiconductor equipment design engineer in Silicon Valley. So it’s especially fascinating to realize that not only Moore's law still relevant and striving, some technologies carry a promise to far exceed any expectations. Thank you, again for being such an enthusiast of your profession. P.S. it is especially fascinating that the first time I’ve even heard about private equity portfolio was on your program. Even your commercials are educating. 😊
@FloridaMeng6 ай бұрын
Yep. She's the cornerstone for all ai and technology matters for me.
@tehgriefer93176 ай бұрын
Not like the auto-proclaimed "Tech-Unicorn" Annia is the real deal.
@inspectorcrud6 ай бұрын
I wonder what your personal liability could be with respect to private equity investments.
@Sven_Dongle6 ай бұрын
Morse law? Gordon Moore meets Samuel Morse? 40 years, eh?
@v1kt0u56 ай бұрын
She's amazing indeed... but the only one? this is a disrespect for some others!
@bakedbeings6 ай бұрын
It was a bit easier to imagine useful outcomes for fp8 calculations, but 4 bit (1/8th precision!) is just wild. Fun times in computer science 🎉
@paultparker6 ай бұрын
Have you seen the paper about high performing one bit LLM’s? They actually require two bits, but they’re still half the size of an FP4.
@nopponw25256 ай бұрын
Thank you very much. You simplify the field that I ever thought i cant understand it to be more reasonable conversation. Please keep making this video 🎉
@cosmicaug6 ай бұрын
5:32 «Honestly, 4 bits is quite low and that makes me curious to see how well it's going to work for inference application.» There's a relatively recent paper out there that suggests you can do pretty well using a single trinary bit, or values of -1, 0, +1 (about 1.585 binary bits equivalent), for your weights.
6 ай бұрын
Love how balance are always your videos! You almost never succumb to the hype! :)
@yougeo6 ай бұрын
I think her explanation is interesting of the double chip in makes me realize that it really isn't some great breakthrough but it was actually the second choice that Jensen had to make because tmsc could not make the next great density improvements with the greater scale. That's interesting to know. It's also interesting to know that their costs are going to go up and their margins may not be as high. One thing I've never understood though is why TM sc isn't the company that makes all the margins and why they let some company like Nvidia which just gives them designs and doesn't make anything why they let in video make the margins.
@donaldhenderson18706 ай бұрын
Never heard about analog chip. Very cool indeed!
@oldtools60896 ай бұрын
giant chips comprised of compartmentalized chiplets running in parallel is *obviously* better than the current commercial paradigm cudas are jamming on, but I believe that the ideal hierarchy of space and appropriated cache looks more like IBM/Motorola's Cell. Visualizing answers to human problems should be given a structure that provides chip designers with an inherently optimized skeleton to experiment with while maximizing throughput for unique formulas.
@Integr8d6 ай бұрын
When Anastasi goes to the car dealer to negotiate a purchase, they end up paying her.
@juansolo-w5g6 ай бұрын
Moore‘s law : Talk about the cost Not the amount. The complexity for minimum component costs has increased at a rate of roughly a factor of two per year. Certainly over the short term this rate can be expected to continue, if not to increase. Over the longer term, the rate of increase is a bit more uncertain, although there is no reason to believe it will not remain nearly constant for at least 10 years.
@David-ln8qh5 ай бұрын
People keep redefining Moore's Law so they can say it's still relevant. It was never a measure of performance.
@ashleyobrien49376 ай бұрын
I cannot get over the SIZE of that thing ! it's huge ! I thought there's just be some more die shrinking and vertical stacking etc. but NEVER did I think we'd see entire wafers as one discreet unit !
@dchdch82906 ай бұрын
We need bigger GPUs ! 😎
@mdo51216 ай бұрын
the man can really sell it...right
@aipsong6 ай бұрын
Another great video!!!! Thanks!!!
@hallkbrdz6 ай бұрын
Should they really be called GPUs now? They aren't processing graphics, but code for LLM, etc. Wouldn't MLPU or AIPU be more appropriate?
@andrepaes39086 ай бұрын
They are already been called NPU "Neural Processing Unit" by Intel, Qualcomm, AMD, etc
@seikojin6 ай бұрын
It will be interesting to see how software will have to evolve in order to maintain accuracy of results when the compute is having to be scaled up to handle the pathway to get there (since it is not as precise). As odd as it is, it would be alot like a cows digestive process. recycling the output as a new input to refine the result. But being much faster in each cycle.
@bigbluebuttonman11376 ай бұрын
Cerebras Chip + 3d-stacking = monstrous process powering in a dense package.
@MobyGoCollection6 ай бұрын
I wonder if they'll be able to do high quality analog audio streaming with this? Like, vinyl or tape through the computer without the downsides (hiss, flutter, crackling)
@CliftonDavis-je7qu6 ай бұрын
Mind blown 🤯
@JaenEngineering6 ай бұрын
Interesting that the analogue chip is using digital for multiplication given how simple it is with analogue compared to digital. Look up the "Gilbert Cell". It can do four quadrant multiplication with differential inputs using only 6 transistors.
@pentachronic6 ай бұрын
Look the noise figures for. Gilbert cell. SNR might be a problem.
@JaenEngineering6 ай бұрын
Maybe, maybe not. It all kinda depends on the resolution. Let's say you want to multiply 2 x 4-bit (0-15) numbers and get an 8-bit (0-255) output, with both inputs and outputs normalised to 1 volt full scale. Each input is only 0.0625v/step The output is only 0.0039v/step Both of those are well within the capability of even a £15 Amazon multimeter.
@kayakMike10006 ай бұрын
Cerebrus has defective parts that are routed around if they are defective. I am nearly certain that chiplets would be a much better design that far more scalable, especially if there were large caches in the 3D side...
@sanfordschoolfield7106 ай бұрын
Thanks
@AnastasiInTech6 ай бұрын
Thank you
@rsum123able6 ай бұрын
Hi Anastasia. Always love your content! Tesla also creates its' own chips coupled with Nvidia's chips. 👍
@CliftonDavis-je7qu6 ай бұрын
Thank you Anastasia your great
@jeanchindeko54776 ай бұрын
Just this might not the the first time this have been done in the ARM world, right? Maybe in the GPU space, but we’ve already seen 2 dies glue together to form one chip with the Apple Silicon, isn’t it?
@FighterFred6 ай бұрын
That investing app is only available for Apple users. As for AI, regardless of hardware they always depend on static input for the learning process. So there is no real creativity there, a language model cannot replicate human thinking. It is well known that our brain is the most complicated structure found anywhere.
@TheEVEInspiration6 ай бұрын
Hmm, multiplication is a much more costly operation than adding, is it not? How would doing addition in analog help then overall?
@TheFurlock6 ай бұрын
The aquarium is the original analog matrix, its grid is built on its contents and the chemistry is fluid so it doesn’t need to preview its active at the moment memory, water is filled.
@victorpinasarnault91355 ай бұрын
Hey Anastasi, read about the TetraMEM SoC. I'm certain that you will like.
@hatobeats6 ай бұрын
Ana, please adjust your sound. There's a persistent noise in the videos. It could be interference affecting your audio interface's mic preamp, or perhaps the cable is faulty. Regardless, it's not a significant issue because there are numerous VSTs available that can enhance dialogue with a single button press. Examples include Voxessor by Soundevice Digital (UnitedPlugins), Waves Clarity VX Pro, iZotope Dialogue Match, among others.
@ka9dgx6 ай бұрын
I think a grid of LUTs, in which the weights don't move, and the data flows through, could be a much better architecture. You could reconfigure for any bit size, route around defects, and if you completely eliminate long data lines and routing hardware, could clock at 10 Ghz with far lower power. Imagine GPT4 at 10 billion tokens per second? (Now the latency would be on the order of 10s of uSec, but you could have parallel streams)
@amigatommy76 ай бұрын
Less bits could work once or twice but not much more than twice with diminishing returns.
@rajeshkr126 ай бұрын
Seems getting bigger is the hype. Adding more technicalities on power consumption and heat generation would be more justifiable
@garyclouse72346 ай бұрын
Well... what happens when we design A.I. models to operate on hardware with very low precision? In general, that will work! Anybody analyzed the exceptions?
@tomgooch14226 ай бұрын
Dr. John Gustafson wrote an excellent book describing the FP precision problem and its solution: The End Of Error. An enormous amount of computing power is presently wasted on false precision.
@panama-canada6 ай бұрын
For a real breakthrough, we must move away from ones and zeroes.
@randalljones43706 ай бұрын
My one take away from the "En-Charge" technology discussion is this: Yes, we can finally get a reasonable functional clone of the old SAD1024 BBD chip and not have to breathe life back into the seriously fraught technology of the 1970's Reticon fab line. Musicians of the World : we can even create an massively deep analog reverb with the En-Charge tech (one that has sufficient 'reflection surfaces' for reasonable function, unlike earlier BBD-based reverb designs.) - - Sorry for the odd post. I worked in 70's/80's/90's hightech culminating in 11+ years at a then-major maker of IC and system design tools. And I play a few musical instruments. And I still chat with a few musical system designers on technical stuff, once in a while when my skills of circuit noise reduction or odd-component characteristic-knowledge proves beneficial... been doing Dr work for the last 20+ years, but old loves die hard. And the utility/longevity of the BBD-type device is one of those loves. Let's bring back the SAD1024, with many, many, many more taps than before. Again, my apologies for the distraction... back to your regular channel/content.
@pentachronic6 ай бұрын
Bucket brigades were a thing for a while in the 80’s until they got too long and noisy!!
@DaisakuIkeda-nd6en6 ай бұрын
These tecnology is only announced by nvidia, that think more in more die about 320 mm^2 at reality high frequency about 600 mhz), or more in gtx. Transistors is more than 30% respect the best 455 mm^2 actualy.
@zencontroller6 ай бұрын
Brilliant video, im looking forward to having a pc with this technology... Roll on 2025...
@HectorDiabolucus6 ай бұрын
375 TOPS/W is truly amazing! Imagine a 4090 OC-ed to the max but using less than 20W instead of 1,000W.
@gepal79146 ай бұрын
This compound chip looks a lot like the M Ultra package from Apple. That came two years ago.
@daveulmer6 ай бұрын
The problem is that Human Brain works in the domain of Knowledge and Understanding. Whereas AI only deals with Information.
@jtsc2226 ай бұрын
Maybe.
@831Miranda6 ай бұрын
In fact, as far as I am aware, we still do not know quite a bit about the functioning of our brains... which are of course completely 'analog'. As of now, early 2024, I see the AI approach as a whole as not the development of super-intelligent quasi-beings, but more of an aggressively hyped race to develop massive automation of what has been called 'knowledge work' which is the most costly form of human labor to businesses everywhere. Thus the AI hype is really about devaluation of human labor in favor of ... We are not evolving and investing in basic science but rather in automation gadgets.... Tho I do hope I'm wrong...
@notbfg90006 ай бұрын
Weird, I thought the Mythic guys had the best approach. Sad to hear it's not working out for them.
@Toruk.Makto.Dracarys6 ай бұрын
Would Photonic Chips solve these issues❓ Thank You Anastasi 💥✨💫🌟🌟
@PedroSantos-fw6gk6 ай бұрын
Imagine a future where you run a large multi-input generative model locally in your phone
@clips44386 ай бұрын
why are wafers always circles?
@intothebeyond87636 ай бұрын
I think we're starting to see the limitations of a GPU maker making AI chips for the data center vs a company that started out by making chips only for AI. Nvidia can't use their typical strong arm tactics with AMD, Qualcomm, Cerebras and Intel like they did with their AIB's to corner the market . So they'll really have to come up with something new and exciting to keep their current market share .
@strrangerthings70496 ай бұрын
Is it also outperforming less's law too
@Sonotbearface6 ай бұрын
The chips are cool and will extend us into AGI but once the AGI learns the process it will create an even better chip
@lucysluckyday6 ай бұрын
I think Moore meant that the process nodes would keep getting smaller proportionally as more transistors were added. But these companies are simply just printing trillions of transistors onto a single wafer of like 12". Well sure, you can print 10 trillion onto a wafer of an 18" or even100" diameter too if you really wanted, but is that actually breaking "Moore's law", or is it just breaking world records of "monolithic lore"?
@shahabdolatabadi41166 ай бұрын
Ma'am, if you are a chip designer, I think a profound and clear tutorial for computer architecture and practical chip design would be a contribution. Thanks for your videos.
@v1kt0u56 ай бұрын
Okay 🤣
@Ubya_6 ай бұрын
"profund and clear" and "tutorial" don't go really hand in hand. there's a reason why a degree takes years
@shahabdolatabadi41166 ай бұрын
@@Ubya_ Apparently, you haven't seen any of the many great courses available on KZbin, many of which far better than those courses by Ivy league universities. Simply put, you're wrong buddy.
@Gravity3606 ай бұрын
@@shahabdolatabadi4116 well that is actually an opinion. People learn based on several factors. Some are audio learners, some kinesthetic and then there's the one's who can just read the information. Some use a combination of the methods. But when it comes down to the 'course', it's honestly gonna be better if they use one or more of the known learning styles to present the information. Sometimes it can come down to having a analogy that is easy for people to relate the information to. Good example on this is computer networking being compared to the Mail/Postal system. I have found some KZbin video's very informative because they meet these standards and it makes it easier to digest the information for retention.
@anirudhapandey12346 ай бұрын
As an engineer from this industry, I would like to say this channel is very informative and UpToDate.
@SarahSchiffer-mj5el6 ай бұрын
Any chance you could cover Extropic AI and their new thermodynamic processors? I think it seems like a promising area of development but I havent seen it covered by any experts I trust
@AnastasiInTech6 ай бұрын
I've read their light paper. It's interesting. I would be curious to learn more if anyone can connect me to them..
@dchdch82906 ай бұрын
from 8bit to 4bit ... we are looking at the next Turing Award candidate here :D
@colinmiddleton94446 ай бұрын
So they have found that you get better and more efficient intelligence with less accuracy. It all makes sense now. That explains everything.
@almightysapling6 ай бұрын
No need to stop there. Just read a paper that claims you can drop to 1.58 bits (just 0 and +/- 1) and get basically the same quality.
@Sven_Dongle6 ай бұрын
@@almightysapling BS
@yahiiia92696 ай бұрын
@@Sven_Dongle It's true.
@iliasiosifidis45326 ай бұрын
I was excited about acceleration since 2021, that Blender changed from Cuda to Optix. Oh boy, same GPU, but 7 times faster renders! Acceleration is the future for sure
@gamesndrinks6 ай бұрын
Who else ran to the channel at sublight speed
@AustinThomasPhD6 ай бұрын
I would be impressed by anyone running at greater than sublight speeds.
@yeejay63966 ай бұрын
Beans
@JumpDiffusion6 ай бұрын
Everyone
@drunknmasta906 ай бұрын
Duh I have mass
@jtjames796 ай бұрын
@@AustinThomasPhD I identify as a tachion you bigot!
@FuzTheCat6 ай бұрын
At this rate in another 2 generations, and Nvidia will have 1-bit FP operations for AI with 4 times the performance increase. Can't wait for the AI performance that half bit will bring!
@joe_limon6 ай бұрын
There is a research paper showing scaling these networks down to binary and there was great efficiency, speed and memory gains.
@robbdudeson3466 ай бұрын
Sometimes less is more
@danmarquez39716 ай бұрын
Anastasi is insanely amazing! She is incredibly smart to understand this technology, and simultaneously, beautiful enough to be a super model! She represents the next step in human evolution!
@ZoOnTheYT6 ай бұрын
After watching some videos of Neurolinks first participant, Noland...I wonder if in the end the analog component digital is going to connect with for the most powerful, and most energy efficient output is our brains.
@nahkanukke6 ай бұрын
I have watched your content from beginning and it have been very informative. I love the way you present science of computing. Keep these comming. Thanks Anastasi🐿
@amribraheem86746 ай бұрын
How does Cerebras deal with the cooling problem over such area?
@timswartz45206 ай бұрын
or pay for it?
@douginorlando62606 ай бұрын
You are creating for yourself a remarkable reputation as the source of accurate knowledgeable and relevant IC technology. And this reputation is a valuable commodity that can’t be easily replaced. CONGRATS. I’ve been around chip tech since the PDP8 computer was built on 7400 series Chips that only had a handful of gates per chip. There’s been many technology approaches & architectures over the years and you seem to have an accurate perspective of how the horse race of chip technology plays out.
@TickerSymbolYOU6 ай бұрын
Awesome breakdown of some of the most important technologies in the world!
@billknight73426 ай бұрын
Wasn't Apple's Ultra chip a dual well before this "first time" chip?
@tom-et-jerry6 ай бұрын
whaoooo i'm waiting for this new technology (analog chip with capacitors) with great impatience ! it will blow my mind ! I love all your videos ! I'm a programmer.
@DaveShap6 ай бұрын
Love your coverage. Great work. Thanks!
@pythonyousufparyani84076 ай бұрын
Thank You for another video. I am gonna watch it now.
@RestlessBenjamin6 ай бұрын
Great video today. I've heard a little bit about these new chips but your explanations really helped me understand why they are so important.
@Hermas_3606 ай бұрын
Great content but I must admit that the first time that got to your channel I thought that you were created by IA, anyway keep up the good work. saludos
@ROBOTRIX_eu6 ай бұрын
..soon, they will start stacking these large wafers like Cerebras over each other.. ..Hibrid chips ..analog and digital..
@MrValgard6 ай бұрын
interesting so we comes from 8bit to 16 to 32 and 64 era and now going back to 8 and even 4bit? o.O
@bakedbeings6 ай бұрын
Games with 16 colour sprites are going to be lit 🔥
@sethfinley63376 ай бұрын
That’s the difference between CPU’s and GPU’s though. You don’t need that precision in GPU’s which is why you see this change, while CPU’s will stay at at least 64
@MrValgard6 ай бұрын
@@sethfinley6337 oh thx I thought we talking all in one a.i. chips and wonder which module give those 4bit instructions xd
@DGNG-dd3to6 ай бұрын
They say this shit every year. Price are still out of control, and technology isn't getting cheaper. Ots more expensive.
@bass305-HCCA6 ай бұрын
Anastasi looking beautiful as usual 😍
@henrismith74726 ай бұрын
I doubt she puts on a suit to do her KZbin videos to hear that. She probably hears that all the time. It's true though lol.
@brandonhoffman47126 ай бұрын
Moores law is dead. We are never outperforming moores law again. Moores law has to do with transistor density, not computing power. Transistor density leads to computer power, but computer power is not the measure used in moores law. We are in the era of making bigger chips. Notice the size difference of the processors in his hands? Gotta read through the hype. What Nvidia is doing is impressive, but Nvidia doesnt even make chips, they cant beat moores law.
@kostyanoob5 ай бұрын
Very good overview. Thanks, Anastasia. My comment is that a *solid software stack* is the real key to the adoption of every new hardware architecture out there. That's also the success behind nvidia...
@JohnSmith762A11B6 ай бұрын
Anastasi would make a great Chief Engineer on a starship. Now we just need to create the starship! Not the SpaceX one, more like the Enterprise.
@TrumpIsrael20246 ай бұрын
She could be 7 of 9.
@roqofort51102 ай бұрын
That Cerebras chip is just radical, this is why I like your channel, your videos are one step ahead of the rest on cutting edge technology x)
@justfellover6 ай бұрын
While there is statistical variation in the exact release date of individual advances, Moore's law marches on.
@SzTz1006 ай бұрын
The only chip I know how to design is thick cut and deep fried.
@En1Gm4A6 ай бұрын
you got telescope images on your phone background + plus points on that
@JoeLion556 ай бұрын
7:30 to be fair to Moore’s law… It doesn’t really state that transistors “per chip” doubles. It states that transistors “per area” doubles. The Cerebras chips are not breaking that - they are still putting the same number of transistors per square cm as the other N5 TSMC chips are. It’s just that historically “chip sizes“ have roughly been the same, more or less, generation to generation, due to manufacturing constraints, heat dissipation, system design constraints, package design, etc. So assuming the chips are roughly the same size, if transistors shrink then the transistor amount doubles from one generation to the next, then that roughly means transistors per chip has doubled. But in reality, the Moores law charts should all have transistors per square centimeter as the y-axis, not transistors per chip. (And for the pendants, of course Moore’s law has also been modified to indicate “performance per area” instead of just transistors per area). Having said all that, breaking free of the standard maximum die size as constrained by the photo mask and interlinking multiple dies together so they effectively function as one chip is a pretty incredible breakthrough, without using an interposer or other off-die layer like the Intel “Tiles” or AMD “chiplets” use.
@pentachronic6 ай бұрын
Agree, this is misleading saying breaking Moore’s Law. Not true. Wafer scale has been done before. Thing new.
@HansVanIngelgom5 ай бұрын
I once profiled a program that I suspected to be slow because it copied gigabytes of data multiple times. The copying time was only marginal. Instead, it spent most of the time performing a log calculation, then rounding the results. I implemented a low resolution log function that turned out to be faster than the fpu version. That's when I learned that calculating something up to an insane amount of digits is often a huge waste.
@BrianFedirko5 ай бұрын
DTA: Decade of Technoloical Advancement. It's a good acronym. DTA does seem to be applicable to this era in time. Analog is a good use of the letter "A" too, as I love the concept of analog computing and chips. It would be nice to someday print 100 electronic devices on a single wafer, and use them out of pocket at a whim. The phone is starting to become this, but I'm sure some smarty pants can collect more divergent ideas on a new multi device. I'd love to be able to microwave a pizza from my pocket... haha. Gr8! Peace ☮💜
@alexb.68005 ай бұрын
Idea for the next video: make a review of your stock picks related to semiconductors and related industry.
@flashskape56 ай бұрын
get her voicemod ffs.
@jamesjohn25376 ай бұрын
Hahahaha is 😂😂😂 first time seeing you telling jokes out of the blue. Cheers 🎉 have great Easter
@sahandehteshami74046 ай бұрын
TSMC 3nm yeild should be 60% but i predict lower.
@mordokai5976 ай бұрын
lol, i'm trying to pay attention, but i keep thinking "OMG! she's waving a wafer around again" xD I still remember "the incident" with the shattered wafer ;)
@JohnSmall3146 ай бұрын
Love the content, I've sent it to my friends
@willykang12936 ай бұрын
1. Jensen Huang: It’s ok, hopper.😂😂 2. TSMC had to make the fabs super clean so they must change those filters on top of the fabs so frequently maybe once within three months. And those activated carbons inside the filters must completely new, they cannot bear the cost if those activated carbons are reused even. 3. Morris Chang once lived in a house maybe close to 20 years ago and it’s just next to my brother house now, by the way.
@zerorusher6 ай бұрын
Since Nvidia was forced to use N4p, its safe to say that another leap on performance is almost guaranteed on next iteration from improvement alone. Regarding the decision to make FP4 the standard, the tradeoff between more parameters/less precision makes sense since there are recent studies showing that quantized models show negligible performance drop when compared with full precision, and that training models with lower precision from scratch may close the gap even further (given the right architecture, of course). About the hybrid chips using capacitors for addition, I wonder if another benefit on the future could be the ability to asynchronously discharge the accumulated charge when a certain threshold is reached. Such architecture could resemble neuron spikes and the way the human brain works asynchronously and with lower frequency.
@bbamboo36 ай бұрын
My father taught me analog computing as a teenager, two pots could multiply. He was a rocket scientist and totally understood digital computing however he also continued to say that analog computing was not being used effectively. inertial guidance was partly analog in the beginning. How interesting to see the hybrid approach implemented in cmos.
@chriswininger30226 ай бұрын
Jonathan Mills was one of my favorite professors in college. He was doing a lot of amazing work on modern analog computing and hybrids cns.iu.edu/docs/netscitalks/j-mills.pdf. Sadly he has sense passed. Great thinker, good teacher
@KIsADragon6 ай бұрын
You are really gorgeous... 😘 Hence Subscribed.
@taith26 ай бұрын
When i think of it, regular RAM is also capacitor based Why didn't chip manufacturers slap a lot of capacitors in form of metal layers directly on chip? After all transistor cache doesnt scale well compated to logic gates It will require rewriting EDA software from the grounds up But gains will be astonishing in my opinion
@Salara21306 ай бұрын
U have to love science. Everything always sounds so bombastic in highly complex. But then you get down to it and it comes down to "just use 2 chips" "just decrease the size of numbers you calculate with" "just use some redundancy".
@trstquint71146 ай бұрын
I give a LIKE after 5 sec. although the clip itself takes 21 minutes.
@FloridaMeng6 ай бұрын
I'd be disappointed if you didn't.
@honkytonk44656 ай бұрын
That's impressive.I am so proud.
@Larsonaut6 ай бұрын
*tips his fedora
@randalljones43706 ай бұрын
From what I've heard from other content creators, the LIKE carries more weight in the YT algorithm if it is given > 10 min into the video, or in the last 10% of the video (if shorter than 10 min). This was YT's attempt to reduce the effect of video-voting-bot-armies which (could) artificially pump up creators. Apparently, gaming the algorithm is a thing.
@everettputerbaugh39966 ай бұрын
IBM was the computer to beat in the 1050s, 60s, and 70s. They started out using 4 bit words (Binary Coded Decimal) and moved through Extended B.C.D. (6 bit words) to 8 bit words (ASCII). Some modern equip. uses Unicode (16 bit words) which can represent nearly every written language in use today. The size of the work affects the amount of work the chip can do in a given bit of time and especially how much physical memory is used for each character. IF all you are doing is math, you don't need big words.
@Narcissus-q8n6 ай бұрын
Anastasi, what do you think about Qualcomm's future in this space?
@tonep31686 ай бұрын
Sorry nGreedia, Apple did this first, years ago!
@nihel31445 ай бұрын
Aint no way ur calling apple competitors greedy 💀
@tonep31685 ай бұрын
@@nihel3144 Please educate yourself on nGreedia business practices before you defend them. They are no better than Apple, possibly worse.