NVIDIA RTX A6000 First Look for Data Science 48GB Ampere GPU

[@HeatonResearch]

Oh and by the way... Yes, it will run Cyberpunk 2077 :-) instagram.com/p/CLAwFnyhN4p/

[@sakibkhondaker]

Jhonny will be happy

[@monkyspnk777]

But will it run cyberpunk 2077 at ultra 4K with anti-aliasing? Mwahahahaha!

[@mirlenahildavillacortaolaz8766]

How many fps?

[@reinhardtbdc4647]

As an aside, I am sure most people do not know this as well. The reason it shows at 44GB of RAM is because of ECC. ECC is on by default, it uses one chip for parity data, so each chip on that board must be 4GB. My K80s in ECC mode go from 12GB to 11GB. In the Nvidia control panel, you can disable ECC(requires a reboot), if you need the extra 4GB.

[@angelg3986]

Imagine if on the servers when you put 32GB DDR-4 you get only 30, because of the ECC 🙂. So NVidia is *lying* that there are 48GB ECC - there are 44GB ECC.

[@erikschiegg68]

What a beauty the "professor's" RTX A6000 is. The new bling!

[@HeatonResearch]

Indeed! Thanks!

[@seanreynoldscs]

I would like benchmarks for the A6000 vs a 3090 on the same training set.

[@Jordan-389]

Same

[@HeatonResearch]

That would be an interesting comparison, and probably something outside of the range of what I could setup right now. My guess is that it would be similar if you do not need >24GB RAM on the GPU. For something that parallel-izes really well (GAN training comes to mind), two 3090s would likely outperform a single A6000. Of course, realize that 24GB on two 3090s can't do all of the same things as 48GB on a single A6000. Generally, you are mirroring training data and parameters. Cooling two 3090s is going to be more challenging than cooling a single A6000, or even two A6000s.

[@bodsun9036]

@@HeatonResearch yep, 3090 is so big and costing 350w power

[@weylandsmith5924]

Jeff, I got a workstation with two 3090s. If you want, we can run benchmarks and compare them. Just give me the benchmark notebooks and I'll run them.

[@brdklt]

@@weylandsmith5924 u lucky guy

[@DruuzilTechGames]

4:44 - They're DisplayPort 1.4 ports, not DVI. DVI is pretty much dead/legacy, and is a larger white connector.

[@sovitrath4735]

I really appreciate NVidia sending all these GPUs to Data Science and deep learning KZbinrs. Makes me really happy. But will it also do the same for those who write deep learning tutorials? Like I have my own deep learning/machine learning website where I write articles and tutorials. I require GPU on a regular basis, but there is only so much I can do with my GTX 1060 laptop. I really want to amp up my tutorial quality. Hope NVidia does the same for those who write tutorials as well. Great video as always.

[@HeatonResearch]

So, how you attract a vendor's attention for this sort of thing, is to publish your material to social media. Tag the vendor when you post it, this is how I attracted some attention. I am far from a mega-channel.

[@sovitrath4735]

@@HeatonResearch Wow! really thank you for the advice. Will surely try to implement it. And regarding your channel, it is one of the best blends of knowledge about deep learning hardware and software that I have ever seen. You show us the hardware, you go into detail about its specification, you even show how to install it in a machine. And your code explanations are just as good. I hope that your channel really takes off to millions of subscribers.

[@SuperSigma69]

@@sovitrath4735 🤦

[@richardojogun8418]

waiting for nvidia to release an RTX A8000. I bet that would either be a 64GB or 96GB vram graphics card.

[@ProjectPhysX]

At the time that was infeasible, with a max of 2GB per GDDR6 chip and maximum of 24 memory chips (12 on front, 12 on back) on the PCB. But with stacked GDDR6W (4GB per chip), we might finally see 96GB cards soon!

[@CODEMENTAL]

And I was so happy with my RTX 3070 :-)

[@summiTHVH]

Cries in integra

[@viktorreznov4718]

@@summiTHVH Drunkenly sobs in Windows Soviet.

[@bharcooldude]

Aah I just ordered a GPU server for my team with dual A100s. Was looking for A40 and A6000 but Dell couldn't validate them in time :(

[@HeatonResearch]

I will be comparing A100 to A6000 soon, that is on the list. Sounds like I nice system, though.

[@weylandsmith5924]

@@HeatonResearch Interesting.. Will they provide a PCI-express A100?

[@monkyspnk777]

Why do I need 10,000 cores? Train a Machine Learning model in hours vs yrs Train an Ai in years vs decades.

[@axe863]

Bruh..... give varying depth Random ReLU feature space expansion a chance........

[@jimsinnovations2737]

wow you are so lucky my guy, hope you enjoy that one day ill get one. ONE DAY lol

[@George_ace]

👆👆 I GOT 3080 WITH A FAIR PRICE FROM THEM

[@MarcelloNesca]

Hi Jeff, can you please do a model comparison between a 3090 and the A6000 please in terms of speed?

[@nicolass8941]

HI Jeff, and thank you for your all quality videos. You spoke about comparaison between RTX 3090 and A6000, it is possible to have you opinion about the Nvidia A30 option ? The price is really close to the A6000. Thanks for all from France ;)

[@ProjectPhysX]

The A30 is a cut-down A100 with only 24GB, with a GA100 die inside. It can do FP64 at 1:2 rate to FP32. The A6000 48GB and 3090 24GB are both GA102 and mostly incapable of FP64 (1:64 rate to FP32).

[@11folders]

Have you done any speed tests comparing the A6000 to the 8000?

[@George_ace]

👆GET FROM THEM FOR A FAIR PRICE

[@chriscambridge5737]

You never clarified if the A6000 is a turbo/blower GPU, or not? I would be really interested to know.

[@Idtelos]

I use two of these as gpu accelerators in CFD simulations in ANSYS FLUENT.

[@unibrowser1]

You should have left the Titan in the next slot. I'm fairly sure the Studio drivers are the same for both cards. For example I use a RTX 3060 and a RTX 2070 Super. They work perfectly together for video editing

[@George_ace]

👆 THEY ARE BEST HIT UP FOR A GOOD PRICE

[@ClaudeNova]

Thanks so much for such awesome content. A humble request, would you please highlight whether the performance is worth the expense. Would it be better to buy 2 x 3090s? Perhaps indicate from your experience whether the unlocked features as well as the ECC ram on the card affect inference to the extent that 3090s aren't appropriate for DataScience.

[@HeatonResearch]

That would be an interesting comparison, and probably something outside of the range of what I could setup right now. My guess is that it would be similar if you do not need >24GB RAM on the GPU. For something that parallel-izes really well (GAN training comes to mind), two 3090s would likely outperform a single A6000. Of course, realize that 24GB on two 3090s can't do all of the same things as 48GB on a single A6000. Generally, you are mirroring training data and parameters. Cooling two 3090s is going to be more challenging than cooling a single A6000, or even two A6000s.

[@weylandsmith5924]

@@HeatonResearch I can add a bit about that. Using two GPUs, the easiest way to achieve parallelism is indeed data parallelism (i.e. Pytorch's DataParallel). In this way, data batches are not mirrored, and each gpu gets its own half of the current minibatch. Other than that, bear in mind that there are 3090s specifically made for multi-gpu configurations. Actually you can tightly stack four of them in a desktop, and still get zero cooling issues since they blow all the hot air out of the case: www.pugetsystems.com/labs/articles/Quad-GeForce-RTX-3090-in-a-desktop---Does-it-work-1935/ I got two of them, and the maximum temp I get is barely 71-72C for the upper card.

[@DrUBashir]

@@weylandsmith5924 Hey Weyland, would you recommend a 2x3090 over 1xA6000? I am looking at several builds, but getting some mixed opinion esp. that the performance increase giong 2x3090 may not be that huge (although the CUDA cores are so many more)

[@11folders]

What type of performance tradeoffs should I consider, if I use the RTX A6000 in an eGPU via Thunderbolt connection?

[@firstsipstudios]

Really love your videos! It feels like your uncle teaching you all the cool tech stuff. Cheers and Happy Holidays!

[@AOTanoos22]

Amazing, this gpu is what dreams are made off xD

[@HeatonResearch]

I have been dreaming about it lately. 😲😴

[@tfaktas]

Can you add more A6000s to it? does the motherboard support it?

[@haralc]

Would you please compare it with Intel Compute Stick 2?

[@puddles1364]

Thanks for sharing Jeff!

[@harry1010]

I HAVE BEEN WAITING FOR THIS!!!!!!!

[@kaushiksb1832]

Seems like jeff's low-key the relaxing end

[@samiulislamsharan]

you should change the cooler to something else like noctua. that corsair aio isn't covering the whole cpu.

[@ichallengemydog]

Where did you order the PCIe to 8-pin CPU splitter cable?

[@HeatonResearch]

It came with the GPU.

[@andreyeliseyev]

Hello. Is this GPU can be powered from ATX PSU directly with standard PCIE connector and without this Y-splitter cable? Thanks.

[@HeatonResearch]

Yes, once I buy that cable.

[@osoriony]

Fantastic video. Thank you very much for sharing your experience. I am getting a new workstation with the main purpose of 8K video editing. Did you see faster rendering of your KZbin video with this card?

[@HeatonResearch]

I do not do 8K at this point but for HD and 4K, premiere pro loves the new card. Have not formally benchmarked it though, does feel faster. This will only improve as software better embraces Ampere.

[@osoriony]

@@HeatonResearch Thank you very much.

[@marekkovac7058]

Hey! thanks for an overview video! May I ask, what are the noise levels in full load? I would Assume very loud since it's like 3090 with blower style and 300W, but I see you have it right next to the monitor, so I'm curious how much dB does it produce? Thanks!

[@HeatonResearch]

I have my recording setup/mics specifically tuned to eliminate noise, such as the fan or my dog snoring under the desk. Measured with a highly scientific iPhone 😊, the room, with nothing running is 45db and 60db with the A6000 running full fan.

[@marekkovac7058]

@@HeatonResearch wow 60dB is pretty loud considering I saw 86 temperature. Thanks for the info!

[@davidaustin9700]

You’re the best Jeff!

[@disarmyouwitha]

still relevant^.^ thank you!

[@emilwallner8548]

Great overview!! Just bought four myself :) Did you manage to find a PSU cable with two PCIe going to one CPU 8-pin connector?

[@HeatonResearch]

Ah, very cool! I ordered one and am waiting on that currently. Once I am sure I won't be occasionally swapping the TITAN RTX back in, I will switch.

[@tek_soup]

Im gonna buy, This, Since Prices, are so out of hand, anyways.

[@George_ace]

👆THEY GOT DOPE PC HIT UP

[@diuco17]

What is the difference in use cases and performance between this and an a100?

[@George_ace]

👆 THEY GOT GPU ,3060,3070,3080,MANY MORE FOR A FAIR MARKET PRICE

[@dankchan420]

How loud is the A6000 fan/blower? I’m keen to buy one but I’m not sure if it will distract my colleagues

[@HeatonResearch]

Running at 80% it is about 60 decibels, as measured by my iPhone. By contrast, a silent room in my house is 40. In an office setting, you would hear it for sure, but not overly obnoxious (at least to me).

[@hamzamuhammadkhan]

Woahhh !!!!!! The great Jeff Heaton 🤚

[@HeatonResearch]

Thanks! And thank you NVIDIA!

[@hamzamuhammadkhan]

@@HeatonResearch sir can you do one for AMD ... For ROCm library .. there is really minimal information about it

[@akhiladecosta9326]

Can you please review the A4000?

[@George_ace]

👆GET FROM THEM FOR A FAIR PRICE

[@vb433]

Best X570 mother board for dual rtx A5000*2 (Cpu 5950x) Would you recommend any list

[@George_ace]

👆 THEY ARE BEST HIT UP FOR A GOOD PRICE

[@lineage13]

Please run some scientific benchmarks on it! A few batch tests and use cases with different resolutions against other gpus.

[@Edario]

You sir might be the luckiest guy in the world if not one of the luckiest.

[@HeatonResearch]

Thanks! Yes I am quite thankful to NVIDIA for this.

[@dipak1220]

Can you please share the specs for the entire workstation? or if I can find it somewhere on your channel or blog?

[@HeatonResearch]

Just updated the descriptions.

[@CoquiAudio]

I still remember my first video card purchase that was ATi Radeon 512MB at that time I thought was a lot look now wow!

[@Cooper3312000]

A few more years and I'll be able to afford this card for my ESXi home lab server since it supports vGPU profiles and has a ton of VRAM. Might get the A5000 for now upgrade from the Tesla P4.

[@lowqchannel]

how is 3060 compare to google colab free version

[@bambumbambu]

what are you using it for?

[@schoohendraworks9424]

the GPU is not for gaming, but making the game :D

[@marcusmarcula]

I hope they release lower end such as a5000 and a4000, preferably with option for nvlink

[@HeatonResearch]

It will be interesting to see how the axxxx series unfolds.

[@jcmozart5016]

But can it run crysis ?

[@HeatonResearch]

Isn't that always the question, though! :)

[@esra_erimez]

You beat me to it!

[@techtam3505]

All ways best as your videos series.

[@HeatonResearch]

Thanks!

[@tukangjawa5140]

Mom, i need this for my online schooll... 😗

[@HeatonResearch]

Need to just get it on the school supply lists.

[@unibrowser1]

Put the Titan on the second slot and utilize both 😉

[@BradHelm]

Damn. Just, damn. I just found a new shade of green for my jealousy, Jeff. :-)

[@HeatonResearch]

If you are wondering what the actual box looks like, if you get this card through more traditional retail, www.leadtek.com/eng/products/workstation_graphics(2)/NVIDIA_Quadro_RTX_A6000(30893)/detail

[@battosaijenkins946]

@Jeff Heaton, Hey man just a word of advice. Never daisy chain power connectors to your rtx cards. Yeah I know psu supply them but it's their way of cutting costs. Always use separate 8 pin connects for each plug in, if that makes sense. Yeah most won't care and do it daisy chaining, but if you're using it for high end rendering, ai simulations, neural networks, or in my case 4x 3090 FE's for mining, separate connections EACH to pardon my French, 'Cover your @$$'... See ya im outta here~

[@HeatonResearch]

@@battosaijenkins946 Good advice

[@batuhanbayraktar337]

ı want to this D: . Hey NVIDIA or Investors I am creating a start up. We need that ( 4 a6000 :( )

[@HeatonResearch]

Cloud use of A100 might be a good option.

[@MatthewRalston89]

@@HeatonResearch could you recommend a retailer and/or affiliate code for a retailers for this card? Can you also suggest any that do educational discounts with Nvidia?

[@weylandsmith5924]

@@MatthewRalston89 There are indeed EDU discounts, but you have to be a teacher, not a student. For example, delta computers offers the A6000 for 3700eur with the EDU discount. But then you can buy two 3090s with such money, even without any discount.

[@andreyeliseyev]

It will be interesting to know what etherium mining hashrate on this card. Can you do the test?

[@HeatonResearch]

Sure: kzbin.info/www/bejne/gKqtmomNgKaji6M

[@andreyeliseyev]

@@HeatonResearch I think every modern GPU should mine ETH now then not in use for other things. Especially then mining profit is over the roof now.

[@jasb78]

We're here for the seeing what the card can do. Why are you wasting 5 minutes just building the computer? There are other channels dedicated to pc builds.

[@George_ace]

👆👆 CHECK OUT FOR A FAIR PRICE

[@weylandsmith5924]

Quite a card ;-) Is it loud under stress?

[@HeatonResearch]

Yes it is loud, have not specifically measured it yet..

[@gavril3698]

You need a really good camera, the content it's amazing, you just need a bit of lightning and camera quality

[@HeatonResearch]

Thanks, yes that is an evolving process.

[@sharky_spike]

4 DISPLAY PORTS...not DVI

[@George_ace]

👆THEY GOT DOPE PC HIT UP

[@javierrodriguezbustos3348]

The best explication 😀😀😀

[@HeatonResearch]

Thank you so much 😀

[@Usernotknown21]

I wonder how that handles cyberpunk 2077?

[@HeatonResearch]

It handles it pretty well, actually. instagram.com/p/CLAwFnyhN4p/

[@Usernotknown21]

How does it compare to something like the 3090 or 3080? How does it do with frames per second?

[@LangaArchitects]

Is this supposed to be better than RTX8000?

[@HeatonResearch]

I've used both, and yes the A6000 is faster. Same memory. Right now the A6000 fills the same top spot in the professional workstation GPU line that the Quadro RTX 8000 filled. I am not sure if NVIDIA is holding the "A8000" name for an even more powerful card in this line.

[@peelthebananna9827]

I wonder how this compares to a 3090 or rtx 6000 in professional work loads.

[@HeatonResearch]

I think that is a real question if you do not need the memory. I don't have the hardware to test that. I am looking forward to some 3090 benchmarks myself.

[@peelthebananna9827]

@@HeatonResearch great, I love your video keep up the great work👍

[@weylandsmith5924]

@@HeatonResearch Look above at my topmost reply ;)

[@Decco6306]

oh okay so this new A series is like their new brand of Quadro cards (or tesla) interesting

[@Jibs-HappyDesigns-990]

look world gloves!! yup! 4 real !! nice presentation Jeff! popcorn engaged! the Angel on his shoulder says: hand with care!! the devil on the other shoulder, yells out. nail this card 2 the floor Jeff!! woohoo!! I'm like thinking, mastercard ''will'' cover & warranty this product!! though I ''think'' nVidia has a lifetime guarantee. but I'm not 4 sure!! good luck!!

[@George_ace]

👆 THEY GOT GPU ,3060,3070,3080,MANY MORE FOR A FAIR MARKET PRICE

[@hoaxuan7074]

Nice anti-static handling technique. I highly recommend it for all nvidia cards. Also nvidia cards may have a massive mis-match between compute and memory bandwidth for the newer and faster NN algorithms. For the NN segment of the market they face huge re-engineering costs. However I'm sure they have the money. Anyway it's not their fault. It's down to the broken foundations of NN research. The failure even to apply the scientific method to the dot product and other simple aspects of NNs.

[@nguyenngocly1484]

Yeh, they don't even know how to use the dot product as a general associative memory by meeting the demands of the variance equation. Ie. Random projection, non-linear function, dot product. Terrible basic research. The NN books start in the middle and work forward. No one looked back to check the basics and challange assumptions.⚠⚠⚠

[@bigdreams5554]

Awesome. I may go for broke and get one of these before the bots and scalpers pick them all up.

[@adamross4295]

Good for Plex?!

[@davefarquhar8230]

I'm insanely curious how many points per day Foldingathome would estimate on that card.

[@HeatonResearch]

I never did get into that, but might be worth a try.

[@VatsalSingh007]

Nice.

[@jonatan01i]

I feel your pain! :( 11:15

[@George_ace]

👆 GET FROM THEM ASAP GIVING OUT DISCOUNT ON ALL PRODUCT

[@leung63401]

It is powerful but can it play cyberpunk2077¿

[@HeatonResearch]

It does pretty well, actually... instagram.com/p/CLAwFnyhN4p/

[@hashiraknightwalker393]

Nice

[@Chavacano]

Not many people can afford a A6000..so why dont you talk about the A4000 or the A5000.......which is more in line with what most people will use..

[@HeatonResearch]

They did not exist at the time I made this video. I will probably cover them in a future video. I do have videos on cheaper cards, such as: kzbin.info/www/bejne/eYGknpyIoLVmi5I

[@Chavacano]

@@HeatonResearch Thank you, would be good if you can do a video to supplement the latest RTX A0000 series, on the RTX A4000 and the RTX5000 seen as you've done one on the RTX6000. These are obviously the more affordable and latest Nvidia GPU's that most of us would be interested learning more about specifically and perhaps some demos on their performance...As the RTX A6000 is out of our budget....and most of us will never see the light of day actually using..... probably a good idea on the more affordable versions of its line. Thank you. Great video Jeff, keep up the great work

[@gavril3698]

Actally 48 :)

[@AlessandroSilvarte]

Quero uma de presente 😊😊😅😅😅🎁

[@darius6917]

Might wanna get some real fans in your case. A6000 with Corsair disco fans is not the look.

[@HeatonResearch]

Good points, but so far so good with the system cooling, I do monitor GPU/CPU/RAM temps. The temperature is in an acceptable range and not throttling.

[@darius6917]

@@HeatonResearch Understood. Yet still a shame for such a beautiful and powerful GPU...to be disrespected with Corsair anything.

[@nyftn]

lol the bitlocker . just login to your microsoft account on another pc to get your bitlocker key .

[@tomasgemes4349]

No vr ready wtf

[@Old-Boy_BEbop]

i dont care what anyone says, blowers have always been the best for my system... such a pity this design has been pushed out. by far the best looking gpu... every other design has been hot garbage... too gamerish, screams im only 4 foot 5 but i have 22 inch tires with 8 wheel drive that can rock climb with tower like suspension cause it looks "kewl" with tons of RGB

[@eckee]

Gimme

[@George_ace]

👆GET FROM THEM FOR A FAIR PRICE

[@Fordance100]

Nothing data science, just installation.