Python CUDA Installation & CUPY | GPU Acceleration Basics 01

CUPY is a Numpy-like array implementation for NVIDIA CUDA. In this video, I have walked through the installation process and the basics of CUPY. Python can compile and run NVIDIA CUDA accelerated applications. In this tutorial series learn to use CUDA on Python with cupy and numba. Accelerate your applications by leveraging the parallel processing of a GPU.
Playlist: • Acceleration Basics wi...
Python beginners Tutorial Playlist: • Python Beginners Tutorial
This second lecture is about installing CUDA toolkit from NVIDIA and doing our first acceleration using CUPY.
#python #cuda #nvidia #programming #coding #gpu

[@nagen78]

simple and straight to the point.

[@rounakpaul001]

Thank you, appreciate the comment.

[@taj-ulislam6902]

Unique information - hard to find. Much appreciate your effort.

[@rounakpaul001]

Thank you

[@rajatpaul3728]

Helpful

[@rounakpaul001]

Thank you

[@kingkeshu5561]

nice video. Pretty helpful!

[@rounakpaul001]

Thank you

[@ah_bb8267]

I wished i had knew about this before. Numpy uses a lot of ram and cpu. I was looking for a way to shift some of the data preprocessing workload onto the GPU. Does tensorflow recognise cupy arrays as valid input data types like numpy arrays? Great video.

[@rounakpaul001]

Numpy and Tensor has similar data structure, but CuPy has completely different data structure as the pool it uses is from the GPU, not the system RAM. But you can still do conversions and have a hybrid code running in CPU and GPU: import tensorflow as tf import cupy as cp # Create a CuPy array cupy_array = cp.array([1, 2, 3]) # Convert CuPy array to NumPy array numpy_array = cp.asnumpy(cupy_array) # Use NumPy array as input to TensorFlow tensor = tf.constant(numpy_array) # Perform TensorFlow operations on the tensor result = tf.math.square(tensor) print(result)

[@ah_bb8267]

​@@rounakpaul001Thanks 🙏

[@itsamitnitrkl5199]

My doubt is also same , can be use copy for ml models

[@yadongwang8629]

thanks for sharing. So if I am using M1 Macbook. I can install the cupy in python and use Colab to mimic the GPU?

[@rounakpaul001]

By CuPy devs: "We cannot guarantee that CuPy works on other environments like MacOs, even if it looks like it is working" On mac, your best acceleration options are: Metal API or Vulkan Compute pipeline For learning and prototyping algorithms you can use google colab's TGPU.

[@rounakpaul001]

If using Colab, no need to install CuPy on your M1 computer. The colab does the setup on the cloud VM by itself.

[@ОлегФедоров-з7д]

Thank you! Tell me, can I put a ready-made script code in Python into this shell and run it through the GPU and not the CPU?

[@rounakpaul001]

In short, mostly no. The script will always be run on the CPU, but your computation tasks you can do on GPU. The architecture of the CPU and GPU are different. Using python modules to run programs on the gpu may look similar to a normal python program, but underneath it's different. With some modifications you can probably run your functions on the gpu.

[@cattnation6257]

will you help me? i can code but configration always sucks me

[@rounakpaul001]

I will try, kindly explain the problem you are facing.

[@cattnation6257]

@@rounakpaul001 i am working on somthing where i use yolo mediapipe and tensorflow i code enough to do my work and code working properly but the issue is i cant able to use gpu so when a video i pass throw my function the one frame take 300 ms and its two slow i have nivdea gpu 4060 install 12 version i always have issue in version what should i do

[@infernophoenix1575]

Just a quick question, does this method work even with laptops with AMD GPU's or this is only restricted to only NVIDIA GPU-type laptops

[@rounakpaul001]

The methods are currently limited to NVIDIA GPUs. AMD has launched their new CUDA equivalent toolkits recently, I will learn it when I can get my hand on an AMD GUP system.

[@tkz4_on_osu295]

Best Indian tutorial I’ve ever seen🙌

[@rounakpaul001]

thank you