Рет қаралды 1,670
In this video, I show you how to accelerate Transformer training with AWS Trainium, a new custom chip designed by AWS.
First, I walk you through the setup of an Amazon EC2 trn1.32xlarge instance, equipped with 16 Trainium chips. Then, I run a natural language processing job where I adapt existing Transformer training code for Trainium, accelerating a BERT model to classify the Yelp review datatset. Finally, I run the job on 1, 8, and 32 Neuron cores.
⭐️⭐️⭐️ Don't forget to subscribe to be notified of future videos ⭐️⭐️⭐️
⭐️⭐️⭐️ Want to buy me a coffee? I can always use more :) www.buymeacoff... ⭐️⭐️⭐️
AWS Trainium: aws.amazon.com...
AWS Neuron SDK documentation: awsdocs-neuron...
AWS Neuron SDK samples: github.com/aws...
Hugging Face tutorial: huggingface.co...
Setup steps and code: gitlab.com/jul...
Interested in hardware acceleration? Check out my other videos :
Habana Gaudi: • Accelerate Transformer...
Graphcore: • Accelerate Transformer...
Trainium on SageMaker: • Accelerate Transformer...