Now you possibly can strive just a few instructions, similar to checking GPU-related info.
ubuntu@158-101-120-14:~$ nvidia-smi
Sat Mar 8 12:23:49 2025
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 550.127.08 Driver Model: 550.127.08 CUDA Model: 12.4 |
|-----------------------------------------+------------------------+----------------------+
| GPU Identify Persistence-M | Bus-Id Disp.A | Unstable Uncorr. ECC |
| Fan Temp Perf Pwr:Utilization/Cap | Reminiscence-Utilization | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+========================+======================|
| 0 NVIDIA A100-SXM4-40GB On | 00000000:06:00.0 Off | 0 |
| N/A 33C P0 46W / 400W | 1MiB / 40960MiB | 0% Default |
| | | Disabled |
+-----------------------------------------+------------------------+----------------------++-----------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Sort Course of title GPU Reminiscence |
| ID ID Utilization |
|=========================================================================================|
| No working processes discovered |
+-----------------------------------------------------------------------------------------+
ubuntu@158-101-120-14:~$ nvidia-smi --query-gpu=title,reminiscence.whole,reminiscence.free,driver_version --format=csv
title, reminiscence.whole [MiB], reminiscence.free [MiB], driver_version
NVIDIA A100-SXM4-40GB, 40960 MiB, 40327 MiB, 550.127.08
ubuntu@158-101-120-14:~$ nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2024 NVIDIA Company
Constructed on Thu_Mar_28_02:18:24_PDT_2024
Cuda compilation instruments, launch 12.4, V12.4.131
Construct cuda_12.4.r12.4/compiler.34097967_0
ubuntu@158-101-120-14:~$ nvidia-smi | grep "CUDA Model"
| NVIDIA-SMI 550.127.08 Driver Model: 550.127.08 CUDA Model: 12.4 |
ubuntu@158-101-120-14:~$ python3 -c "import torch; print(torch.cuda.is_available(), torch.cuda.get_device_name(0))"
True NVIDIA A100-SXM4-40GB
