Nvidia cuda toolkit 12 2 0 for windows 11
Author: d | 2025-04-24
Download the NVIDIA CUDA Driver: Command Prompt as the primary system shell for Windows 11. Press ⊞ Windows yes install cuda-toolkit-12-0 cuda-toolkit-11-1 Add NVIDIA to the Source
Difference between nvidia-cuda-toolkit and cuda-toolkit-12-6
Powerful and reliable programming model and computing toolkit Home Developer Tools NVIDIA CUDA Toolkit 12.8.0 (for Windows 11) Old Versions Browse by CompanyAdobe, Apowersoft, Ashampoo, Autodesk, Avast, Corel, Cyberlink, Google, iMyFone, iTop, Movavi, PassFab, Passper, Stardock, Tenorshare, Wargaming, Wondershare Sponsored January, 24th 2025 - 3.2 GB - Freeware Review Change Log Old Versions NVIDIA CUDA Toolkit 12.8.0 (for Windows 11) Date released: 24 Jan 2025 (one month ago) NVIDIA CUDA Toolkit 12.8.0 (for Windows 10) Date released: 24 Jan 2025 (one month ago) NVIDIA CUDA Toolkit 12.6.0 (for Windows 11) Date released: 02 Aug 2024 (8 months ago) NVIDIA CUDA Toolkit 12.5.0 (for Windows 11) Date released: 22 May 2024 (10 months ago) NVIDIA CUDA Toolkit 12.4.0 (for Windows 11) Date released: 06 Mar 2024 (one year ago) NVIDIA CUDA Toolkit 12.3.0 (for Windows 11) Date released: 20 Oct 2023 (one year ago) NVIDIA CUDA Toolkit 12.2.0 (for Windows 11) Date released: 29 Jun 2023 (one year ago) NVIDIA CUDA Toolkit 12.0.1 (for Windows 11) Date released: 01 Mar 2023 (2 years ago) NVIDIA CUDA Toolkit 12.0.0 (for Windows 11) Date released: 09 Dec 2022 (2 years ago) NVIDIA CUDA Toolkit 11.8.0 (for Windows 11) Date released: 04 Oct 2022 (2 years ago) NVIDIA CUDA Toolkit 11.7.0 (for Windows 11) Date released: 12 May 2022 (3 years ago) NVIDIA CUDA Toolkit 11.6.1 (for Windows 11) Date released: 11 Mar 2022 (3 years ago) NVIDIA CUDA Toolkit 11.6.0 (for Windows 11) Date released: 13 Jan 2022 (3 years ago) NVIDIA CUDA Toolkit 12.2.0 (for Windows 10) Date released: 29 Jun 2023 (one year ago) NVIDIA CUDA Toolkit 12.0.1 (for Windows 10) Date released: 01 Mar 2023 (2 years ago) NVIDIA CUDA Toolkit 12.0.0 (for Windows 10) Date released: 09 Dec 2022 (2 years ago) NVIDIA CUDA Toolkit 11.8.0 (for Windows 10)
NVIDIA CUDA Toolkit 12. - Chocolatey Software
]cuda-runtime-11-7 11.7.1-1 [NVIDIA CUDA/ ]cuda-samples-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-samples-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-samples-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-samples-11-0 11.0.221-1 [NVIDIA CUDA/ ]cuda-samples-11-1 11.1.105-1 [NVIDIA CUDA/ ]cuda-samples-11-2 11.2.152-1 [NVIDIA CUDA/ ]cuda-samples-11-3 11.3.58-1 [NVIDIA CUDA/ ]cuda-samples-11-4 11.4.120-1 [NVIDIA CUDA/ ]cuda-samples-11-5 11.5.56-1 [NVIDIA CUDA/ ]cuda-samples-11-6 11.6.101-1 [NVIDIA CUDA/ ]cuda-sanitizer-11-0 11.0.221-1 [NVIDIA CUDA/ ]cuda-sanitizer-11-1 11.1.105-1 [NVIDIA CUDA/ ]cuda-sanitizer-11-2 11.2.152-1 [NVIDIA CUDA/ ]cuda-sanitizer-11-3 11.3.111-1 [NVIDIA CUDA/ ]cuda-sanitizer-11-4 11.4.120-1 [NVIDIA CUDA/ ]cuda-sanitizer-11-5 11.5.114-1 [NVIDIA CUDA/ ]cuda-sanitizer-11-6 11.6.124-1 [NVIDIA CUDA/ ]cuda-sanitizer-11-7 11.7.91-1 [NVIDIA CUDA/ ]cuda-sanitizer-api-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-sanitizer-api-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-thrust-11-3 11.3.109-1 [NVIDIA CUDA/ ]cuda-toolkit-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-toolkit-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-toolkit-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-toolkit-11-0 11.0.3-1 [NVIDIA CUDA/ ]cuda-toolkit-11-1 11.1.1-1 [NVIDIA CUDA/ ]cuda-toolkit-11-2 11.2.2-1 [NVIDIA CUDA/ ]cuda-toolkit-11-3 11.3.1-1 [NVIDIA CUDA/ ]cuda-toolkit-11-3-config-common 11.3.109-1 [NVIDIA CUDA/ ]cuda-toolkit-11-4 11.4.4-1 [NVIDIA CUDA/ ]cuda-toolkit-11-4-config-common 11.4.148-1 [NVIDIA CUDA/ ]cuda-toolkit-11-5 11.5.2-1 [NVIDIA CUDA/ ]cuda-toolkit-11-5-config-common 11.5.117-1 [NVIDIA CUDA/ ]cuda-toolkit-11-6 11.6.2-1 [NVIDIA CUDA/ ]cuda-toolkit-11-6-config-common 11.6.55-1 [NVIDIA CUDA/ ]cuda-toolkit-11-7 11.7.1-1 [NVIDIA CUDA/ ]cuda-toolkit-11-7-config-common 11.7.99-1 [NVIDIA CUDA/ ]cuda-toolkit-11-config-common 11.7.99-1 [NVIDIA CUDA/ ]cuda-toolkit-config-common 11.7.99-1 [NVIDIA CUDA/ ]cuda-tools-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-tools-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-tools-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-tools-11-0 11.0.3-1 [NVIDIA CUDA/ ]cuda-tools-11-1 11.1.1-1 [NVIDIA CUDA/ ]cuda-tools-11-2 11.2.2-1 [NVIDIA CUDA/ ]cuda-tools-11-3 11.3.1-1 [NVIDIA CUDA/ ]cuda-tools-11-4 11.4.4-1 [NVIDIA CUDA/ ]cuda-tools-11-5 11.5.2-1 [NVIDIA CUDA/ ]cuda-tools-11-6 11.6.2-1 [NVIDIA CUDA/ ]cuda-tools-11-7 11.7.1-1 [NVIDIA CUDA/ ]cuda-visual-tools-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-visual-tools-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-visual-tools-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-visual-tools-11-0 11.0.3-1 [NVIDIA CUDA/ ]cuda-visual-tools-11-1 11.1.1-1 [NVIDIA CUDA/ ]cuda-visual-tools-11-2 11.2.2-1 [NVIDIA CUDA/ ]cuda-visual-tools-11-3 11.3.1-1 [NVIDIA CUDA/ ]cuda-visual-tools-11-4 11.4.4-1 [NVIDIA CUDA/ ]cuda-visual-tools-11-5 11.5.2-1 [NVIDIA CUDA/ ]cuda-visual-tools-11-6 11.6.2-1 [NVIDIA CUDA/ ]cuda-visual-tools-11-7 11.7.1-1 [NVIDIA CUDA/ ]graphsurgeon-tf 8.4.3-1+cuda11.6 [NVIDIA CUDA/ ]libcuda1-340 340.108-0ubuntu8 [Ubuntu/jammy multiverse]libcuda1-384 418.226.00-0ubuntu1 [NVIDIA CUDA/ ]libcudart11.0 11.5.117~11.5.1-1ubuntu1 [Ubuntu/jammy multiverse]libcudnn8 8.5.0.96-1+cuda11.7 [NVIDIA CUDA/ ]libcudnn8-dev 8.5.0.96-1+cuda11.7 [NVIDIA CUDA/ ]libnccl-dev 2.14.3-1+cuda11.7 [NVIDIA CUDA/ ]libnccl2 2.14.3-1+cuda11.7 [NVIDIA CUDA/ ]libnvinfer-bin 8.4.3-1+cuda11.6 [NVIDIA CUDA/ ]libnvinfer-dev 8.4.3-1+cuda11.6 [NVIDIA CUDA/ ]libnvinfer-plugin-dev 8.4.3-1+cuda11.6 [NVIDIA CUDA/ ]libnvinfer-plugin8 8.4.3-1+cuda11.6 [NVIDIA CUDA/ ]libnvinfer-samples 8.4.3-1+cuda11.6 [NVIDIA CUDA/ ]libnvinfer8 8.4.3-1+cuda11.6 [NVIDIA CUDA/ ]libnvonnxparsers-dev 8.4.3-1+cuda11.6 [NVIDIA CUDA/ ]libnvonnxparsers8 8.4.3-1+cuda11.6 [NVIDIA CUDA/ ]libnvparsers-dev 8.4.3-1+cuda11.6 [NVIDIA CUDA/ ]libnvparsers8 8.4.3-1+cuda11.6 [NVIDIA CUDA/ ]nvidia-cuda-dev 11.5.1-1ubuntu1 [Ubuntu/jammy multiverse]nvidia-cuda-gdb 11.5.114~11.5.1-1ubuntu1 [Ubuntu/jammy multiverse]nvidia-cuda-toolkit 11.5.1-1ubuntu1 [Ubuntu/jammy multiverse]nvidia-cuda-toolkit-doc 11.5.1-1ubuntu1 [Ubuntu/jammy multiverse]nvidia-cuda-toolkit-gcc 11.5.1-1ubuntu1 [Ubuntu/jammy multiverse]nvidia-cudnn 8.2.4.15~cuda11.4 [Ubuntu/jammy multiverse]onnx-graphsurgeon 8.4.3-1+cuda11.6 [NVIDIA CUDA/ ]python-pycuda-doc 2021.1~dfsg-2build2 [Ubuntu/jammy multiverse]python3-libnvinfer 8.4.3-1+cuda11.6 [NVIDIA CUDA/ ]python3-libnvinfer-dev 8.4.3-1+cuda11.6 [NVIDIA CUDA/ ]python3-pycuda 2021.1~dfsg-2build2 [Ubuntu/jammy multiverse]python3-pyhst2-cuda 2020c-5build1 [Ubuntu/jammy multiverse]relion-cuda 3.1.0-2 [Ubuntu/jammy multiverse]relion-gui-cuda 3.1.0-2 [Ubuntu/jammy multiverse]tensorrt 8.4.3.1-1+cuda11.6 [NVIDIA CUDA/ ]tensorrt-dev 8.4.3.1-1+cuda11.6 [NVIDIA CUDA/ ]tensorrt-libs 8.4.3.1-1+cuda11.6 [NVIDIA CUDA/ ]uff-converter-tf 8.4.3-1+cuda11.6 [NVIDIA CUDA/ ]Seems versions match up, 11.7Would love some help! Did you got any help , I am facing the same issue .Downloading NVIDIA CUDA Toolkit 12.4.0 (for Windows 11
]cuda-nsight-systems-11-6 11.6.2-1 [NVIDIA CUDA/ ]cuda-nsight-systems-11-7 11.7.1-1 [NVIDIA CUDA/ ]cuda-nvcc-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-nvcc-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-nvcc-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-nvcc-11-0 11.0.221-1 [NVIDIA CUDA/ ]cuda-nvcc-11-1 11.1.105-1 [NVIDIA CUDA/ ]cuda-nvcc-11-2 11.2.152-1 [NVIDIA CUDA/ ]cuda-nvcc-11-3 11.3.109-1 [NVIDIA CUDA/ ]cuda-nvcc-11-4 11.4.152-1 [NVIDIA CUDA/ ]cuda-nvcc-11-5 11.5.119-1 [NVIDIA CUDA/ ]cuda-nvcc-11-6 11.6.124-1 [NVIDIA CUDA/ ]cuda-nvcc-11-7 11.7.99-1 [NVIDIA CUDA/ ]cuda-nvdisasm-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-nvdisasm-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-nvdisasm-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-nvdisasm-11-0 11.0.221-1 [NVIDIA CUDA/ ]cuda-nvdisasm-11-1 11.1.74-1 [NVIDIA CUDA/ ]cuda-nvdisasm-11-2 11.2.152-1 [NVIDIA CUDA/ ]cuda-nvdisasm-11-3 11.3.58-1 [NVIDIA CUDA/ ]cuda-nvdisasm-11-4 11.4.152-1 [NVIDIA CUDA/ ]cuda-nvdisasm-11-5 11.5.119-1 [NVIDIA CUDA/ ]cuda-nvdisasm-11-6 11.6.124-1 [NVIDIA CUDA/ ]cuda-nvdisasm-11-7 11.7.91-1 [NVIDIA CUDA/ ]cuda-nvgraph-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-nvgraph-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-nvgraph-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-nvgraph-dev-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-nvgraph-dev-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-nvgraph-dev-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-nvjpeg-10-0 10.0.130.1-1 [NVIDIA CUDA/ ]cuda-nvjpeg-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-nvjpeg-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-nvjpeg-dev-10-0 10.0.130.1-1 [NVIDIA CUDA/ ]cuda-nvjpeg-dev-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-nvjpeg-dev-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-nvml-dev-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-nvml-dev-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-nvml-dev-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-nvml-dev-11-0 11.0.167-1 [NVIDIA CUDA/ ]cuda-nvml-dev-11-1 11.1.74-1 [NVIDIA CUDA/ ]cuda-nvml-dev-11-2 11.2.152-1 [NVIDIA CUDA/ ]cuda-nvml-dev-11-3 11.3.58-1 [NVIDIA CUDA/ ]cuda-nvml-dev-11-4 11.4.120-1 [NVIDIA CUDA/ ]cuda-nvml-dev-11-5 11.5.50-1 [NVIDIA CUDA/ ]cuda-nvml-dev-11-6 11.6.55-1 [NVIDIA CUDA/ ]cuda-nvml-dev-11-7 11.7.91-1 [NVIDIA CUDA/ ]cuda-nvprof-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-nvprof-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-nvprof-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-nvprof-11-0 11.0.221-1 [NVIDIA CUDA/ ]cuda-nvprof-11-1 11.1.105-1 [NVIDIA CUDA/ ]cuda-nvprof-11-2 11.2.152-1 [NVIDIA CUDA/ ]cuda-nvprof-11-3 11.3.111-1 [NVIDIA CUDA/ ]cuda-nvprof-11-4 11.4.120-1 [NVIDIA CUDA/ ]cuda-nvprof-11-5 11.5.114-1 [NVIDIA CUDA/ ]cuda-nvprof-11-6 11.6.124-1 [NVIDIA CUDA/ ]cuda-nvprof-11-7 11.7.101-1 [NVIDIA CUDA/ ]cuda-nvprune-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-nvprune-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-nvprune-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-nvprune-11-0 11.0.221-1 [NVIDIA CUDA/ ]cuda-nvprune-11-1 11.1.74-1 [NVIDIA CUDA/ ]cuda-nvprune-11-2 11.2.152-1 [NVIDIA CUDA/ ]cuda-nvprune-11-3 11.3.58-1 [NVIDIA CUDA/ ]cuda-nvprune-11-4 11.4.120-1 [NVIDIA CUDA/ ]cuda-nvprune-11-5 11.5.119-1 [NVIDIA CUDA/ ]cuda-nvprune-11-6 11.6.124-1 [NVIDIA CUDA/ ]cuda-nvprune-11-7 11.7.91-1 [NVIDIA CUDA/ ]cuda-nvrtc-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-nvrtc-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-nvrtc-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-nvrtc-11-0 11.0.221-1 [NVIDIA CUDA/ ]cuda-nvrtc-11-1 11.1.105-1 [NVIDIA CUDA/ ]cuda-nvrtc-11-2 11.2.152-1 [NVIDIA CUDA/ ]cuda-nvrtc-11-3 11.3.109-1 [NVIDIA CUDA/ ]cuda-nvrtc-11-4 11.4.152-1 [NVIDIA CUDA/ ]cuda-nvrtc-11-5 11.5.119-1 [NVIDIA CUDA/ ]cuda-nvrtc-11-6 11.6.124-1 [NVIDIA CUDA/ ]cuda-nvrtc-11-7 11.7.99-1 [NVIDIA CUDA/ ]cuda-nvrtc-dev-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-nvrtc-dev-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-nvrtc-dev-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-nvrtc-dev-11-0 11.0.221-1 [NVIDIA CUDA/ ]cuda-nvrtc-dev-11-1 11.1.105-1 [NVIDIA CUDA/ ]cuda-nvrtc-dev-11-2 11.2.152-1 [NVIDIA CUDA/ ]cuda-nvrtc-dev-11-3 11.3.109-1 [NVIDIA CUDA/ ]cuda-nvrtc-dev-11-4 11.4.152-1 [NVIDIA CUDA/ ]cuda-nvrtc-dev-11-5 11.5.119-1 [NVIDIA CUDA/ ]cuda-nvrtc-dev-11-6 11.6.124-1 [NVIDIA CUDA/ ]cuda-nvrtc-dev-11-7 11.7.99-1 [NVIDIA CUDA/ ]cuda-nvtx-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-nvtx-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-nvtx-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-nvtx-11-0 11.0.167-1 [NVIDIA CUDA/ ]cuda-nvtx-11-1 11.1.74-1 [NVIDIA CUDA/ ]cuda-nvtx-11-2 11.2.152-1 [NVIDIA CUDA/ ]cuda-nvtx-11-3 11.3.109-1 [NVIDIA CUDA/ ]cuda-nvtx-11-4 11.4.120-1 [NVIDIA CUDA/ ]cuda-nvtx-11-5 11.5.114-1 [NVIDIA CUDA/ ]cuda-nvtx-11-6 11.6.124-1 [NVIDIA CUDA/ ]cuda-nvtx-11-7 11.7.91-1 [NVIDIA CUDA/ ]cuda-nvvp-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-nvvp-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-nvvp-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-nvvp-11-0 11.0.221-1 [NVIDIA CUDA/ ]cuda-nvvp-11-1 11.1.105-1 [NVIDIA CUDA/ ]cuda-nvvp-11-2 11.2.152-1 [NVIDIA CUDA/ ]cuda-nvvp-11-3 11.3.111-1 [NVIDIA CUDA/ ]cuda-nvvp-11-4 11.4.193-1 [NVIDIA CUDA/ ]cuda-nvvp-11-5 11.5.126-1 [NVIDIA CUDA/ ]cuda-nvvp-11-6 11.6.124-1 [NVIDIA CUDA/ ]cuda-nvvp-11-7 11.7.101-1 [NVIDIA CUDA/ ]cuda-repo-ubuntu1804 10.2.89-1 [NVIDIA CUDA/ ]└── cuda repository configuration filescuda-runtime-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-runtime-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-runtime-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-runtime-11-0 11.0.3-1 [NVIDIA CUDA/ ]cuda-runtime-11-1 11.1.1-1 [NVIDIA CUDA/ ]cuda-runtime-11-2 11.2.2-1 [NVIDIA CUDA/ ]cuda-runtime-11-3 11.3.1-1 [NVIDIA CUDA/ ]cuda-runtime-11-4 11.4.4-1 [NVIDIA CUDA/ ]cuda-runtime-11-5 11.5.2-1 [NVIDIA CUDA/ ]cuda-runtime-11-6 11.6.2-1 [NVIDIA CUDA/. Download the NVIDIA CUDA Driver: Command Prompt as the primary system shell for Windows 11. Press ⊞ Windows yes install cuda-toolkit-12-0 cuda-toolkit-11-1 Add NVIDIA to the Source Select the Nvidia driver according to your windows machine alone seen below; sudo apt-get -yes install cuda-toolkit-12-0 cuda-toolkit-11-1 Add NVIDIA to the Source List Directory:NVIDIA CUDA Toolkit 12.5.0 (for Windows 11) Download for
ToolchainNVIDIA CUDA Toolkit (available at Microsoft Windows® operating systems:Microsoft Windows 11 21H2 (SV1)Microsoft Windows 11 22H2 (SV2)Microsoft Windows 11 23H2Microsoft Windows 10 22H2Microsoft Windows Server 2022Table 1 Windows Compiler Support in CUDA 12.6 Update 3Compiler*IDENative x86_64Cross-compilation (32-bit on 64-bit)C++ DialectMSVC Version 193xVisual Studio 2022 17.xYESNot supportedC++14 (default), C++17, C++20MSVC Version 192xVisual Studio 2019 16.xYESC++14 (default), C++17MSVC Version 191xVisual Studio 2017 15.x (RTW and all updates)YESC++14 (default), C++17* Support for Visual Studio 2015 is deprecated in release 11.1; support for Visual Studio 2017 is deprecated in release 12.5.32-bit compilation native and cross-compilation is removed from CUDA 12.0 and later Toolkit. Use the CUDA Toolkit from earlier releases for 32-bit compilation. CUDA Driver will continue to support running 32-bit application binaries on GeForce GPUs until Ada. Ada will be the last architecture with driver support for 32-bit applications. Hopper does not support 32-bit applications.Support for running x86 32-bit applications on x86_64 Windows is limited to use with:CUDA DriverCUDA Runtime (cudart)CUDA Math Library (math.h)1.2. About This DocumentThis document is intended for readers familiar with Microsoft Windows operating systems and the Microsoft Visual Studio environment. You do not need previous experience with CUDA or experience with parallel computation.2. Installing CUDA Development ToolsBasic instructions can be found in the Quick Start Guide. Read on for more detailed instructions.The setup of CUDA development tools on a system running the appropriate version of Windows consists of a few simple steps:Verify the system has a CUDA-capable GPU.Download the NVIDIA CUDA Toolkit.Install the NVIDIA CUDA Toolkit.Test that the installedNVIDIA CUDA Toolkit 12.4.0 (for Windows 11) Download for
Execution.Processing times remain slow, suggesting CPU usage (e.g., encode time = 1510.90 ms / 2 runs).System InformationOS: Windows 11 (or specify your Windows version)GPU: NVIDIA GeForce RTX 2050 (Compute Capability 8.6)Driver Version: 571.96CUDA Version: 12.8whisper.cpp Version: 1.7.4Build Tool: Visual Studio 2022, CMake 3.5+Additional ContextI have verified that ggml-cuda.dll, cudart64_12.dll, and cublas64_12.dll are present in build\bin\Release.dumpbin /dependents ggml-cuda.dll shows dependencies on cudart64_12.dll and cublas64_12.dll.nvidia-smi output:Sat Mar 1 16:06:26 2025+-----------------------------------------------------------------------------------------+| NVIDIA-SMI 571.96 Driver Version: 571.96 CUDA Version: 12.8 ||-----------------------------------------+------------------------+----------------------+| GPU Name Driver-Model | Bus-Id Disp.A | Volatile Uncorr. ECC || Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. || | | MIG M. ||=========================================+========================+======================|| 0 NVIDIA GeForce RTX 2050 WDDM | 00000000:01:00.0 Off | N/A || N/A 44C P0 6W / 55W | 0MiB / 4096MiB | 0% Default || | | N/A |+-----------------------------------------------------------------------------------------+| Processes: || GPU GI CI PID Type Process name GPU Memory || ID ID Usage ||=========================================================================================|| No running processes found |+-----------------------------------------------------------------------------------------+I have tried using the environment variable $env:GGML_CUDA_FORCE_CUBLAS = "yes" without success.Possible Solutions TriedModified src/CMakeLists.txt to link ggml-cuda with whisper.Built multiple times, ensuring all DLLs are present.Updated NVIDIA driver and CUDA toolkit to the latest versions.Request for HelpCould you please advise on why CUDA is not being utilized and how to resolve this issue? I would appreciate any guidance or additional debugging steps to identify the root cause.NVIDIA CUDA Toolkit 12.6.0 (for Windows 11) Download for
[NVIDIA CUDA/ ]cuda-gdb-11-1 11.1.105-1 [NVIDIA CUDA/ ]cuda-gdb-11-2 11.2.152-1 [NVIDIA CUDA/ ]cuda-gdb-11-3 11.3.109-1 [NVIDIA CUDA/ ]cuda-gdb-11-4 11.4.120-1 [NVIDIA CUDA/ ]cuda-gdb-11-5 11.5.114-1 [NVIDIA CUDA/ ]cuda-gdb-11-6 11.6.124-1 [NVIDIA CUDA/ ]cuda-gdb-11-7 11.7.91-1 [NVIDIA CUDA/ ]cuda-gdb-src-10-0 10.0.130-1 [NVIDIA CUDA/ ]└── Contains the source code for cuda-gdbcuda-gdb-src-10-1 10.1.243-1 [NVIDIA CUDA/ ]└── Contains the source code for cuda-gdbcuda-gdb-src-10-2 10.2.89-1 [NVIDIA CUDA/ ]└── Contains the source code for cuda-gdbcuda-gdb-src-11-0 11.0.221-1 [NVIDIA CUDA/ ]└── Contains the source code for cuda-gdbcuda-gdb-src-11-1 11.1.105-1 [NVIDIA CUDA/ ]└── Contains the source code for cuda-gdbcuda-gdb-src-11-2 11.2.152-1 [NVIDIA CUDA/ ]└── Contains the source code for cuda-gdbcuda-gdb-src-11-3 11.3.109-1 [NVIDIA CUDA/ ]└── Contains the source code for cuda-gdbcuda-gdb-src-11-4 11.4.120-1 [NVIDIA CUDA/ ]└── Contains the source code for cuda-gdbcuda-gdb-src-11-5 11.5.114-1 [NVIDIA CUDA/ ]└── Contains the source code for cuda-gdbcuda-gdb-src-11-6 11.6.124-1 [NVIDIA CUDA/ ]└── Contains the source code for cuda-gdbcuda-gdb-src-11-7 11.7.91-1 [NVIDIA CUDA/ ]└── Contains the source code for cuda-gdbcuda-gpu-library-advisor-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-gpu-library-advisor-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-keyring 1.0-1 [NVIDIA CUDA/ ]cuda-libraries-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-libraries-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-libraries-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-libraries-11-0 11.0.3-1 [NVIDIA CUDA/ ]cuda-libraries-11-1 11.1.1-1 [NVIDIA CUDA/ ]cuda-libraries-11-2 11.2.2-1 [NVIDIA CUDA/ ]cuda-libraries-11-3 11.3.1-1 [NVIDIA CUDA/ ]cuda-libraries-11-4 11.4.4-1 [NVIDIA CUDA/ ]cuda-libraries-11-5 11.5.2-1 [NVIDIA CUDA/ ]cuda-libraries-11-6 11.6.2-1 [NVIDIA CUDA/ ]cuda-libraries-11-7 11.7.1-1 [NVIDIA CUDA/ ]cuda-libraries-dev-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-libraries-dev-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-libraries-dev-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-libraries-dev-11-0 11.0.3-1 [NVIDIA CUDA/ ]cuda-libraries-dev-11-1 11.1.1-1 [NVIDIA CUDA/ ]cuda-libraries-dev-11-2 11.2.2-1 [NVIDIA CUDA/ ]cuda-libraries-dev-11-3 11.3.1-1 [NVIDIA CUDA/ ]cuda-libraries-dev-11-4 11.4.4-1 [NVIDIA CUDA/ ]cuda-libraries-dev-11-5 11.5.2-1 [NVIDIA CUDA/ ]cuda-libraries-dev-11-6 11.6.2-1 [NVIDIA CUDA/ ]cuda-libraries-dev-11-7 11.7.1-1 [NVIDIA CUDA/ ]cuda-license-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-license-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-license-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-memcheck-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-memcheck-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-memcheck-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-memcheck-11-0 11.0.221-1 [NVIDIA CUDA/ ]cuda-memcheck-11-1 11.1.105-1 [NVIDIA CUDA/ ]cuda-memcheck-11-2 11.2.152-1 [NVIDIA CUDA/ ]cuda-memcheck-11-3 11.3.109-1 [NVIDIA CUDA/ ]cuda-memcheck-11-4 11.4.120-1 [NVIDIA CUDA/ ]cuda-memcheck-11-5 11.5.114-1 [NVIDIA CUDA/ ]cuda-memcheck-11-6 11.6.124-1 [NVIDIA CUDA/ ]cuda-memcheck-11-7 11.7.91-1 [NVIDIA CUDA/ ]cuda-minimal-build-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-minimal-build-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-minimal-build-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-minimal-build-11-0 11.0.3-1 [NVIDIA CUDA/ ]cuda-minimal-build-11-1 11.1.1-1 [NVIDIA CUDA/ ]cuda-minimal-build-11-2 11.2.2-1 [NVIDIA CUDA/ ]cuda-minimal-build-11-3 11.3.1-1 [NVIDIA CUDA/ ]cuda-minimal-build-11-4 11.4.4-1 [NVIDIA CUDA/ ]cuda-minimal-build-11-5 11.5.2-1 [NVIDIA CUDA/ ]cuda-minimal-build-11-6 11.6.2-1 [NVIDIA CUDA/ ]cuda-minimal-build-11-7 11.7.1-1 [NVIDIA CUDA/ ]cuda-misc-headers-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-misc-headers-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-misc-headers-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-npp-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-npp-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-npp-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-npp-dev-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-npp-dev-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-npp-dev-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-nsight-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-nsight-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-nsight-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-nsight-11-0 11.0.221-1 [NVIDIA CUDA/ ]cuda-nsight-11-1 11.1.105-1 [NVIDIA CUDA/ ]cuda-nsight-11-2 11.2.152-1 [NVIDIA CUDA/ ]cuda-nsight-11-3 11.3.109-1 [NVIDIA CUDA/ ]cuda-nsight-11-4 11.4.120-1 [NVIDIA CUDA/ ]cuda-nsight-11-5 11.5.114-1 [NVIDIA CUDA/ ]cuda-nsight-11-6 11.6.124-1 [NVIDIA CUDA/ ]cuda-nsight-11-7 11.7.91-1 [NVIDIA CUDA/ ]cuda-nsight-compute--10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-nsight-compute-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-nsight-compute-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-nsight-compute-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-nsight-compute-11-0 11.0.3-1 [NVIDIA CUDA/ ]cuda-nsight-compute-11-1 11.1.1-1 [NVIDIA CUDA/ ]cuda-nsight-compute-11-2 11.2.2-1 [NVIDIA CUDA/ ]cuda-nsight-compute-11-3 11.3.1-1 [NVIDIA CUDA/ ]cuda-nsight-compute-11-4 11.4.4-1 [NVIDIA CUDA/ ]cuda-nsight-compute-11-5 11.5.2-1 [NVIDIA CUDA/ ]cuda-nsight-compute-11-6 11.6.2-1 [NVIDIA CUDA/ ]cuda-nsight-compute-11-7 11.7.1-1 [NVIDIA CUDA/ ]cuda-nsight-systems-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-nsight-systems-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-nsight-systems-11-0 11.0.3-1 [NVIDIA CUDA/ ]cuda-nsight-systems-11-1 11.1.1-1 [NVIDIA CUDA/ ]cuda-nsight-systems-11-2 11.2.2-1 [NVIDIA CUDA/ ]cuda-nsight-systems-11-3 11.3.1-1 [NVIDIA CUDA/ ]cuda-nsight-systems-11-4 11.4.4-1 [NVIDIA CUDA/ ]cuda-nsight-systems-11-5 11.5.2-1 [NVIDIA CUDA/NVIDIA CUDA Toolkit 12.8.0 (for Windows 11) Download for
October 3, 2022, 3:33pm 1 Hello :)I’m facing the above error when trying to run deviceQuery. (I’m attempting to enable GPU acceleration on WSL2).All relevant info:./deviceQuery./deviceQuery Starting... CUDA Device Query (Runtime API) version (CUDART static linking)cudaGetDeviceCount returned 35-> CUDA driver version is insufficient for CUDA runtime versionResult = FAILnvidia-smi.exe+-----------------------------------------------------------------------------+| NVIDIA-SMI 517.40 Driver Version: 517.40 CUDA Version: 11.7 ||-------------------------------+----------------------+----------------------+| GPU Name TCC/WDDM | Bus-Id Disp.A | Volatile Uncorr. ECC || Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. || | | MIG M. ||===============================+======================+======================|| 0 NVIDIA GeForce ... WDDM | 00000000:01:00.0 On | N/A || 0% 49C P8 N/A / 72W | 221MiB / 4096MiB | 24% Default || | | N/A |+-------------------------------+----------------------+----------------------++-----------------------------------------------------------------------------+| Processes: || GPU GI CI PID Type Process name GPU Memory || ID ID Usage ||=============================================================================|| 0 N/A N/A 2556 C+G ...wekyb3d8bbwe\Video.UI.exe N/A || 0 N/A N/A 7720 C+G C:\Windows\explorer.exe N/A || 0 N/A N/A 8172 C+G ...5n1h2txyewy\SearchApp.exe N/A || 0 N/A N/A 8640 C+G ...y\ShellExperienceHost.exe N/A || 0 N/A N/A 9888 C+G ...2txyewy\TextInputHost.exe N/A || 0 N/A N/A 11584 C+G ...)\Surfshark\Surfshark.exe N/A || 0 N/A N/A 13380 C+G ...perience\NVIDIA Share.exe N/A || 0 N/A N/A 15724 C+G ...bbwe\Microsoft.Photos.exe N/A |+-----------------------------------------------------------------------------+wslfetchWindows Subsystem for Linux (WSL2)Build: 19043Branch: vb_releaseRelease: Ubuntu 22.04.1 LTSKernel: Linux 5.10.102.1-microsoft-standard-WSL2apt list | grep cudabart-cuda 0.7.00-5 [Ubuntu/jammy multiverse]boinc-client-nvidia-cuda 7.18.1+dfsg-4 [Ubuntu/jammy universe]cuda 11.7.1-1 [NVIDIA CUDA/ ]cuda-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-11-0 11.0.3-1 [NVIDIA CUDA/ ]cuda-11-1 11.1.1-1 [NVIDIA CUDA/ ]cuda-11-2 11.2.2-1 [NVIDIA CUDA/ ]cuda-11-3 11.3.1-1 [NVIDIA CUDA/ ]cuda-11-4 11.4.4-1 [NVIDIA CUDA/ ]cuda-11-5 11.5.2-1 [NVIDIA CUDA/ ]cuda-11-6 11.6.2-1 [NVIDIA CUDA/ ]cuda-11-7 11.7.1-1 [NVIDIA CUDA/ ]cuda-cccl-11-4 11.4.122-1 [NVIDIA CUDA/ ]cuda-cccl-11-5 11.5.62-1 [NVIDIA CUDA/ ]cuda-cccl-11-6 11.6.55-1 [NVIDIA CUDA/ ]cuda-cccl-11-7 11.7.91-1 [NVIDIA CUDA/ ]cuda-command-line-tools-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-command-line-tools-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-command-line-tools-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-command-line-tools-11-0 11.0.3-1 [NVIDIA CUDA/ ]cuda-command-line-tools-11-1 11.1.1-1 [NVIDIA CUDA/ ]cuda-command-line-tools-11-2 11.2.2-1 [NVIDIA CUDA/ ]cuda-command-line-tools-11-3 11.3.1-1 [NVIDIA CUDA/ ]cuda-command-line-tools-11-4 11.4.4-1 [NVIDIA CUDA/ ]cuda-command-line-tools-11-5 11.5.2-1 [NVIDIA CUDA/ ]cuda-command-line-tools-11-6 11.6.2-1 [NVIDIA CUDA/ ]cuda-command-line-tools-11-7 11.7.1-1 [NVIDIA CUDA/ ]cuda-compat-10-0 410.129-1 [NVIDIA CUDA/ ]cuda-compat-10-1 418.226.00-1 [NVIDIA CUDA/ ]cuda-compat-10-2 440.118.02-1 [NVIDIA CUDA/ ]cuda-compat-11-0 450.203.03-1 [NVIDIA CUDA/ ]cuda-compat-11-1 455.45.01-1 [NVIDIA CUDA/ ]cuda-compat-11-2 460.106.00-1 [NVIDIA CUDA/ ]cuda-compat-11-3 465.19.01-1 [NVIDIA CUDA/ ]cuda-compat-11-4 470.141.03-1 [NVIDIA CUDA/ ]cuda-compat-11-5 495.29.05-1 [NVIDIA CUDA/ ]cuda-compat-11-6 510.85.02-1 [NVIDIA CUDA/ ]cuda-compat-11-7 515.65.01-1 [NVIDIA CUDA/ ]cuda-compiler-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-compiler-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-compiler-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-compiler-11-0 11.0.3-1 [NVIDIA CUDA/ ]cuda-compiler-11-1 11.1.1-1 [NVIDIA CUDA/ ]cuda-compiler-11-2 11.2.2-1 [NVIDIA CUDA/ ]cuda-compiler-11-3 11.3.1-1 [NVIDIA CUDA/ ]cuda-compiler-11-4 11.4.4-1 [NVIDIA CUDA/ ]cuda-compiler-11-5 11.5.2-1 [NVIDIA CUDA/ ]cuda-compiler-11-6 11.6.2-1 [NVIDIA CUDA/ ]cuda-compiler-11-7 11.7.1-1 [NVIDIA CUDA/ ]cuda-core-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-core-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-core-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-cross-qnx 10.0.130-1 [NVIDIA CUDA/ ]cuda-cross-qnx-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-cublas-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-cublas-dev-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-cudart-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-cudart-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-cudart-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-cudart-11-0 11.0.221-1 [NVIDIA CUDA/ ]cuda-cudart-11-1 11.1.74-1 [NVIDIA CUDA/ ]cuda-cudart-11-2 11.2.152-1 [NVIDIA CUDA/ ]cuda-cudart-11-3 11.3.109-1 [NVIDIA CUDA/ ]cuda-cudart-11-4 11.4.148-1 [NVIDIA CUDA/ ]cuda-cudart-11-5 11.5.117-1 [NVIDIA CUDA/ ]cuda-cudart-11-6 11.6.55-1 [NVIDIA CUDA/ ]cuda-cudart-11-7 11.7.99-1 [NVIDIA CUDA/ ]cuda-cudart-dev-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-cudart-dev-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-cudart-dev-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-cudart-dev-11-0 11.0.221-1 [NVIDIA CUDA/ ]cuda-cudart-dev-11-1 11.1.74-1. Download the NVIDIA CUDA Driver: Command Prompt as the primary system shell for Windows 11. Press ⊞ Windows yes install cuda-toolkit-12-0 cuda-toolkit-11-1 Add NVIDIA to the Source Select the Nvidia driver according to your windows machine alone seen below; sudo apt-get -yes install cuda-toolkit-12-0 cuda-toolkit-11-1 Add NVIDIA to the Source List Directory:
Downloading NVIDIA CUDA Toolkit 11.6.1 (for Windows 11
Skip to content Navigation Menu GitHub Copilot Write better code with AI Security Find and fix vulnerabilities Actions Automate any workflow Codespaces Instant dev environments Issues Plan and track work Code Review Manage code changes Discussions Collaborate outside of code Code Search Find more, search less Explore Learning Pathways Events & Webinars Ebooks & Whitepapers Customer Stories Partners Executive Insights GitHub Sponsors Fund open source developers The ReadME Project GitHub community articles Enterprise platform AI-powered developer platform Pricing Provide feedback Saved searches Use saved searches to filter your results more quickly //voltron/issues_fragments/issue_layout;ref_cta:Sign up;ref_loc:header logged out"}"> Sign up Notifications You must be signed in to change notification settings Fork 4k Star 38.7k DescriptionDescriptionI am trying to use whisper-cli.exe with CUDA support on Windows to leverage my NVIDIA GeForce RTX 2050 GPU, but the application is not utilizing CUDA (showing CUBLAS = 0 in system_info). Despite following the instructions in the README and making the suggested changes, the program continues to run on the CPU instead of the GPU.Steps to ReproduceInstalled CUDA Toolkit 12.8 from and NVIDIA driver version 571.96 (confirmed via nvidia-smi).Cloned the whisper.cpp repository (version 1.7.4) and navigated to the directory:cd C:\Users\carwy\Downloads\Compressed\whisper.cpp-1.7.4\whisper.cpp-1.7.4Built the project with CUDA support:cmake -B build -DGGML_CUDA=1 -DCMAKE_BUILD_TYPE=Release -DCMAKE_CUDA_ARCHITECTURES=native -DCUDAToolkit_ROOT="C:/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v12.8"cmake --build build --config Release --verboseEnsured all necessary DLLs (ggml-cuda.dll, cudart64_12.dll, cublas64_12.dll) are in build\bin\Release.Modified src/CMakeLists.txt to include:if (GGML_CUDA)target_link_libraries(whisper PRIVATE ggml-cuda)endif()Ran the following command:.\whisper-cli.exe -m "C:\Users\carwy\Desktop\SubtitleApp\SubtitleApp Backupw\SubtitleApp\CoreAssets\Window\ggml-large-v3-turbo-q8_0.bin" -f "C:\Users\carwy\Downloads\Thoi gian troi qua that nhanh.wav"Expected Behaviorsystem_info in the output should show CUBLAS = 1, indicating CUDA is being used.GPU usage should increase (visible in nvidia-smi), and processing times (whisper_print_timings) should be significantly faster on the NVIDIA GeForce RTX 2050.Actual Behaviorsystem_info shows CUBLAS = 0:system_info: n_threads = 4 / 12 | AVX = 1 | AVX2 = 1 | AVX512 = 0 | FMA = 1 | NEON = 0 | ARM_FMA = 0 | F16C = 1 | FP16_VA = 0 | WASM_SIMD = 0 | SSE3 = 1 | SSSE3 = 1 | VSX = 0 | COREML = 0 | OPENVINO = 0 |nvidia-smi shows 0% GPU utilization and 0MiB memory usage duringDownloading NVIDIA CUDA Toolkit 12.2.0 (for Windows 11
[NVIDIA CUDA/ ]cuda-cudart-dev-11-2 11.2.152-1 [NVIDIA CUDA/ ]cuda-cudart-dev-11-3 11.3.109-1 [NVIDIA CUDA/ ]cuda-cudart-dev-11-4 11.4.148-1 [NVIDIA CUDA/ ]cuda-cudart-dev-11-5 11.5.117-1 [NVIDIA CUDA/ ]cuda-cudart-dev-11-6 11.6.55-1 [NVIDIA CUDA/ ]cuda-cudart-dev-11-7 11.7.99-1 [NVIDIA CUDA/ ]cuda-cufft-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-cufft-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-cufft-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-cufft-dev-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-cufft-dev-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-cufft-dev-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-cuobjdump-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-cuobjdump-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-cuobjdump-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-cuobjdump-11-0 11.0.221-1 [NVIDIA CUDA/ ]cuda-cuobjdump-11-1 11.1.74-1 [NVIDIA CUDA/ ]cuda-cuobjdump-11-2 11.2.152-1 [NVIDIA CUDA/ ]cuda-cuobjdump-11-3 11.3.58-1 [NVIDIA CUDA/ ]cuda-cuobjdump-11-4 11.4.120-1 [NVIDIA CUDA/ ]cuda-cuobjdump-11-5 11.5.119-1 [NVIDIA CUDA/ ]cuda-cuobjdump-11-6 11.6.124-1 [NVIDIA CUDA/ ]cuda-cuobjdump-11-7 11.7.91-1 [NVIDIA CUDA/ ]cuda-cupti-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-cupti-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-cupti-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-cupti-11-0 11.0.221-1 [NVIDIA CUDA/ ]cuda-cupti-11-1 11.1.105-1 [NVIDIA CUDA/ ]cuda-cupti-11-2 11.2.152-1 [NVIDIA CUDA/ ]cuda-cupti-11-3 11.3.111-1 [NVIDIA CUDA/ ]cuda-cupti-11-4 11.4.120-1 [NVIDIA CUDA/ ]cuda-cupti-11-5 11.5.114-1 [NVIDIA CUDA/ ]cuda-cupti-11-6 11.6.124-1 [NVIDIA CUDA/ ]cuda-cupti-11-7 11.7.101-1 [NVIDIA CUDA/ ]cuda-cupti-dev-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-cupti-dev-11-0 11.0.221-1 [NVIDIA CUDA/ ]cuda-cupti-dev-11-1 11.1.105-1 [NVIDIA CUDA/ ]cuda-cupti-dev-11-2 11.2.152-1 [NVIDIA CUDA/ ]cuda-cupti-dev-11-3 11.3.111-1 [NVIDIA CUDA/ ]cuda-cupti-dev-11-4 11.4.120-1 [NVIDIA CUDA/ ]cuda-cupti-dev-11-5 11.5.114-1 [NVIDIA CUDA/ ]cuda-cupti-dev-11-6 11.6.124-1 [NVIDIA CUDA/ ]cuda-cupti-dev-11-7 11.7.101-1 [NVIDIA CUDA/ ]cuda-curand-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-curand-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-curand-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-curand-dev-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-curand-dev-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-curand-dev-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-cusolver-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-cusolver-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-cusolver-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-cusolver-dev-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-cusolver-dev-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-cusolver-dev-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-cusparse-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-cusparse-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-cusparse-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-cusparse-dev-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-cusparse-dev-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-cusparse-dev-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-cuxxfilt-11-2 11.2.152-1 [NVIDIA CUDA/ ]cuda-cuxxfilt-11-3 11.3.58-1 [NVIDIA CUDA/ ]cuda-cuxxfilt-11-4 11.4.120-1 [NVIDIA CUDA/ ]cuda-cuxxfilt-11-5 11.5.119-1 [NVIDIA CUDA/ ]cuda-cuxxfilt-11-6 11.6.124-1 [NVIDIA CUDA/ ]cuda-cuxxfilt-11-7 11.7.91-1 [NVIDIA CUDA/ ]cuda-demo-suite-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-demo-suite-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-demo-suite-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-demo-suite-11-0 11.0.167-1 [NVIDIA CUDA/ ]cuda-demo-suite-11-1 11.1.74-1 [NVIDIA CUDA/ ]cuda-demo-suite-11-2 11.2.152-1 [NVIDIA CUDA/ ]cuda-demo-suite-11-3 11.3.58-1 [NVIDIA CUDA/ ]cuda-demo-suite-11-4 11.4.100-1 [NVIDIA CUDA/ ]cuda-demo-suite-11-5 11.5.50-1 [NVIDIA CUDA/ ]cuda-demo-suite-11-6 11.6.55-1 [NVIDIA CUDA/ ]cuda-demo-suite-11-7 11.7.91-1 [NVIDIA CUDA/ ]cuda-documentation-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-documentation-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-documentation-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-documentation-11-0 11.0.228-1 [NVIDIA CUDA/ ]cuda-documentation-11-1 11.1.105-1 [NVIDIA CUDA/ ]cuda-documentation-11-2 11.2.154-1 [NVIDIA CUDA/ ]cuda-documentation-11-3 11.3.111-1 [NVIDIA CUDA/ ]cuda-documentation-11-4 11.4.126-1 [NVIDIA CUDA/ ]cuda-documentation-11-5 11.5.114-1 [NVIDIA CUDA/ ]cuda-documentation-11-6 11.6.124-1 [NVIDIA CUDA/ ]cuda-documentation-11-7 11.7.91-1 [NVIDIA CUDA/ ]cuda-driver-dev-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-driver-dev-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-driver-dev-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-driver-dev-11-0 11.0.221-1 [NVIDIA CUDA/ ]cuda-driver-dev-11-1 11.1.74-1 [NVIDIA CUDA/ ]cuda-driver-dev-11-2 11.2.152-1 [NVIDIA CUDA/ ]cuda-driver-dev-11-3 11.3.109-1 [NVIDIA CUDA/ ]cuda-driver-dev-11-4 11.4.148-1 [NVIDIA CUDA/ ]cuda-driver-dev-11-5 11.5.117-1 [NVIDIA CUDA/ ]cuda-driver-dev-11-6 11.6.55-1 [NVIDIA CUDA/ ]cuda-driver-dev-11-7 11.7.99-1 [NVIDIA CUDA/ ]cuda-drivers 515.65.01-1 [NVIDIA CUDA/ ]cuda-drivers-418 418.226.00-1 [NVIDIA CUDA/ ]cuda-drivers-440 440.118.02-1 [NVIDIA CUDA/ ]cuda-drivers-450 450.203.03-1 [NVIDIA CUDA/ ]cuda-drivers-455 455.45.01-1 [NVIDIA CUDA/ ]cuda-drivers-460 460.106.00-1 [NVIDIA CUDA/ ]cuda-drivers-465 465.19.01-1 [NVIDIA CUDA/ ]cuda-drivers-470 470.141.03-1 [NVIDIA CUDA/ ]cuda-drivers-495 495.29.05-1 [NVIDIA CUDA/ ]cuda-drivers-510 510.85.02-1 [NVIDIA CUDA/ ]cuda-drivers-515 515.65.01-1 [NVIDIA CUDA/ ]cuda-drivers-diagnostic 418.67-1 [NVIDIA CUDA/ ]cuda-drivers-fabricmanager 515.65.01-1 [NVIDIA CUDA/ ]cuda-drivers-fabricmanager-450 450.203.03-1 [NVIDIA CUDA/ ]cuda-drivers-fabricmanager-455 455.45.01-1 [NVIDIA CUDA/ ]cuda-drivers-fabricmanager-460 460.106.00-1 [NVIDIA CUDA/ ]cuda-drivers-fabricmanager-465 465.19.01-1 [NVIDIA CUDA/ ]cuda-drivers-fabricmanager-470 470.141.03-1 [NVIDIA CUDA/ ]cuda-drivers-fabricmanager-495 495.29.05-1 [NVIDIA CUDA/ ]cuda-drivers-fabricmanager-510 510.85.02-1 [NVIDIA CUDA/ ]cuda-drivers-fabricmanager-515 515.65.01-1 [NVIDIA CUDA/ ]cuda-gdb-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-gdb-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-gdb-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-gdb-11-0 11.0.221-1. Download the NVIDIA CUDA Driver: Command Prompt as the primary system shell for Windows 11. Press ⊞ Windows yes install cuda-toolkit-12-0 cuda-toolkit-11-1 Add NVIDIA to the SourceNVIDIA CUDA Toolkit 12.0.1 (for Windows 11) - FileHorse
Software runs correctly and communicates with the hardware.2.1. Verify You Have a CUDA-Capable GPUYou can verify that you have a CUDA-capable GPU through the Display Adapters section in the Windows Device Manager. Here you will find the vendor name and model of your graphics card(s). If you have an NVIDIA card that is listed in that GPU is CUDA-capable. The Release Notes for the CUDA Toolkit also contain a list of supported products.The Windows Device Manager can be opened via the following steps:Open a run window from the Start MenuRun:control /name Microsoft.DeviceManager2.2. Download the NVIDIA CUDA ToolkitThe NVIDIA CUDA Toolkit is available at Choose the platform you are using and one of the following installer formats:Network Installer: A minimal installer which later downloads packages required for installation. Only the packages selected during the selection phase of the installer are downloaded. This installer is useful for users who want to minimize download time.Full Installer: An installer which contains all the components of the CUDA Toolkit and does not require any further download. This installer is useful for systems which lack network access and for enterprise deployment.The CUDA Toolkit installs the CUDA driver and tools needed to create, build and run a CUDA application as well as libraries, header files, and other resources.Download VerificationThe download can be verified by comparing the MD5 checksum posted at with that of the downloaded file. If either of the checksums differ, the downloaded file is corrupt and needs to be downloaded again.2.3. Install the CUDA SoftwareBeforeComments
Powerful and reliable programming model and computing toolkit Home Developer Tools NVIDIA CUDA Toolkit 12.8.0 (for Windows 11) Old Versions Browse by CompanyAdobe, Apowersoft, Ashampoo, Autodesk, Avast, Corel, Cyberlink, Google, iMyFone, iTop, Movavi, PassFab, Passper, Stardock, Tenorshare, Wargaming, Wondershare Sponsored January, 24th 2025 - 3.2 GB - Freeware Review Change Log Old Versions NVIDIA CUDA Toolkit 12.8.0 (for Windows 11) Date released: 24 Jan 2025 (one month ago) NVIDIA CUDA Toolkit 12.8.0 (for Windows 10) Date released: 24 Jan 2025 (one month ago) NVIDIA CUDA Toolkit 12.6.0 (for Windows 11) Date released: 02 Aug 2024 (8 months ago) NVIDIA CUDA Toolkit 12.5.0 (for Windows 11) Date released: 22 May 2024 (10 months ago) NVIDIA CUDA Toolkit 12.4.0 (for Windows 11) Date released: 06 Mar 2024 (one year ago) NVIDIA CUDA Toolkit 12.3.0 (for Windows 11) Date released: 20 Oct 2023 (one year ago) NVIDIA CUDA Toolkit 12.2.0 (for Windows 11) Date released: 29 Jun 2023 (one year ago) NVIDIA CUDA Toolkit 12.0.1 (for Windows 11) Date released: 01 Mar 2023 (2 years ago) NVIDIA CUDA Toolkit 12.0.0 (for Windows 11) Date released: 09 Dec 2022 (2 years ago) NVIDIA CUDA Toolkit 11.8.0 (for Windows 11) Date released: 04 Oct 2022 (2 years ago) NVIDIA CUDA Toolkit 11.7.0 (for Windows 11) Date released: 12 May 2022 (3 years ago) NVIDIA CUDA Toolkit 11.6.1 (for Windows 11) Date released: 11 Mar 2022 (3 years ago) NVIDIA CUDA Toolkit 11.6.0 (for Windows 11) Date released: 13 Jan 2022 (3 years ago) NVIDIA CUDA Toolkit 12.2.0 (for Windows 10) Date released: 29 Jun 2023 (one year ago) NVIDIA CUDA Toolkit 12.0.1 (for Windows 10) Date released: 01 Mar 2023 (2 years ago) NVIDIA CUDA Toolkit 12.0.0 (for Windows 10) Date released: 09 Dec 2022 (2 years ago) NVIDIA CUDA Toolkit 11.8.0 (for Windows 10)
2025-04-08]cuda-runtime-11-7 11.7.1-1 [NVIDIA CUDA/ ]cuda-samples-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-samples-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-samples-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-samples-11-0 11.0.221-1 [NVIDIA CUDA/ ]cuda-samples-11-1 11.1.105-1 [NVIDIA CUDA/ ]cuda-samples-11-2 11.2.152-1 [NVIDIA CUDA/ ]cuda-samples-11-3 11.3.58-1 [NVIDIA CUDA/ ]cuda-samples-11-4 11.4.120-1 [NVIDIA CUDA/ ]cuda-samples-11-5 11.5.56-1 [NVIDIA CUDA/ ]cuda-samples-11-6 11.6.101-1 [NVIDIA CUDA/ ]cuda-sanitizer-11-0 11.0.221-1 [NVIDIA CUDA/ ]cuda-sanitizer-11-1 11.1.105-1 [NVIDIA CUDA/ ]cuda-sanitizer-11-2 11.2.152-1 [NVIDIA CUDA/ ]cuda-sanitizer-11-3 11.3.111-1 [NVIDIA CUDA/ ]cuda-sanitizer-11-4 11.4.120-1 [NVIDIA CUDA/ ]cuda-sanitizer-11-5 11.5.114-1 [NVIDIA CUDA/ ]cuda-sanitizer-11-6 11.6.124-1 [NVIDIA CUDA/ ]cuda-sanitizer-11-7 11.7.91-1 [NVIDIA CUDA/ ]cuda-sanitizer-api-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-sanitizer-api-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-thrust-11-3 11.3.109-1 [NVIDIA CUDA/ ]cuda-toolkit-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-toolkit-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-toolkit-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-toolkit-11-0 11.0.3-1 [NVIDIA CUDA/ ]cuda-toolkit-11-1 11.1.1-1 [NVIDIA CUDA/ ]cuda-toolkit-11-2 11.2.2-1 [NVIDIA CUDA/ ]cuda-toolkit-11-3 11.3.1-1 [NVIDIA CUDA/ ]cuda-toolkit-11-3-config-common 11.3.109-1 [NVIDIA CUDA/ ]cuda-toolkit-11-4 11.4.4-1 [NVIDIA CUDA/ ]cuda-toolkit-11-4-config-common 11.4.148-1 [NVIDIA CUDA/ ]cuda-toolkit-11-5 11.5.2-1 [NVIDIA CUDA/ ]cuda-toolkit-11-5-config-common 11.5.117-1 [NVIDIA CUDA/ ]cuda-toolkit-11-6 11.6.2-1 [NVIDIA CUDA/ ]cuda-toolkit-11-6-config-common 11.6.55-1 [NVIDIA CUDA/ ]cuda-toolkit-11-7 11.7.1-1 [NVIDIA CUDA/ ]cuda-toolkit-11-7-config-common 11.7.99-1 [NVIDIA CUDA/ ]cuda-toolkit-11-config-common 11.7.99-1 [NVIDIA CUDA/ ]cuda-toolkit-config-common 11.7.99-1 [NVIDIA CUDA/ ]cuda-tools-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-tools-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-tools-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-tools-11-0 11.0.3-1 [NVIDIA CUDA/ ]cuda-tools-11-1 11.1.1-1 [NVIDIA CUDA/ ]cuda-tools-11-2 11.2.2-1 [NVIDIA CUDA/ ]cuda-tools-11-3 11.3.1-1 [NVIDIA CUDA/ ]cuda-tools-11-4 11.4.4-1 [NVIDIA CUDA/ ]cuda-tools-11-5 11.5.2-1 [NVIDIA CUDA/ ]cuda-tools-11-6 11.6.2-1 [NVIDIA CUDA/ ]cuda-tools-11-7 11.7.1-1 [NVIDIA CUDA/ ]cuda-visual-tools-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-visual-tools-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-visual-tools-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-visual-tools-11-0 11.0.3-1 [NVIDIA CUDA/ ]cuda-visual-tools-11-1 11.1.1-1 [NVIDIA CUDA/ ]cuda-visual-tools-11-2 11.2.2-1 [NVIDIA CUDA/ ]cuda-visual-tools-11-3 11.3.1-1 [NVIDIA CUDA/ ]cuda-visual-tools-11-4 11.4.4-1 [NVIDIA CUDA/ ]cuda-visual-tools-11-5 11.5.2-1 [NVIDIA CUDA/ ]cuda-visual-tools-11-6 11.6.2-1 [NVIDIA CUDA/ ]cuda-visual-tools-11-7 11.7.1-1 [NVIDIA CUDA/ ]graphsurgeon-tf 8.4.3-1+cuda11.6 [NVIDIA CUDA/ ]libcuda1-340 340.108-0ubuntu8 [Ubuntu/jammy multiverse]libcuda1-384 418.226.00-0ubuntu1 [NVIDIA CUDA/ ]libcudart11.0 11.5.117~11.5.1-1ubuntu1 [Ubuntu/jammy multiverse]libcudnn8 8.5.0.96-1+cuda11.7 [NVIDIA CUDA/ ]libcudnn8-dev 8.5.0.96-1+cuda11.7 [NVIDIA CUDA/ ]libnccl-dev 2.14.3-1+cuda11.7 [NVIDIA CUDA/ ]libnccl2 2.14.3-1+cuda11.7 [NVIDIA CUDA/ ]libnvinfer-bin 8.4.3-1+cuda11.6 [NVIDIA CUDA/ ]libnvinfer-dev 8.4.3-1+cuda11.6 [NVIDIA CUDA/ ]libnvinfer-plugin-dev 8.4.3-1+cuda11.6 [NVIDIA CUDA/ ]libnvinfer-plugin8 8.4.3-1+cuda11.6 [NVIDIA CUDA/ ]libnvinfer-samples 8.4.3-1+cuda11.6 [NVIDIA CUDA/ ]libnvinfer8 8.4.3-1+cuda11.6 [NVIDIA CUDA/ ]libnvonnxparsers-dev 8.4.3-1+cuda11.6 [NVIDIA CUDA/ ]libnvonnxparsers8 8.4.3-1+cuda11.6 [NVIDIA CUDA/ ]libnvparsers-dev 8.4.3-1+cuda11.6 [NVIDIA CUDA/ ]libnvparsers8 8.4.3-1+cuda11.6 [NVIDIA CUDA/ ]nvidia-cuda-dev 11.5.1-1ubuntu1 [Ubuntu/jammy multiverse]nvidia-cuda-gdb 11.5.114~11.5.1-1ubuntu1 [Ubuntu/jammy multiverse]nvidia-cuda-toolkit 11.5.1-1ubuntu1 [Ubuntu/jammy multiverse]nvidia-cuda-toolkit-doc 11.5.1-1ubuntu1 [Ubuntu/jammy multiverse]nvidia-cuda-toolkit-gcc 11.5.1-1ubuntu1 [Ubuntu/jammy multiverse]nvidia-cudnn 8.2.4.15~cuda11.4 [Ubuntu/jammy multiverse]onnx-graphsurgeon 8.4.3-1+cuda11.6 [NVIDIA CUDA/ ]python-pycuda-doc 2021.1~dfsg-2build2 [Ubuntu/jammy multiverse]python3-libnvinfer 8.4.3-1+cuda11.6 [NVIDIA CUDA/ ]python3-libnvinfer-dev 8.4.3-1+cuda11.6 [NVIDIA CUDA/ ]python3-pycuda 2021.1~dfsg-2build2 [Ubuntu/jammy multiverse]python3-pyhst2-cuda 2020c-5build1 [Ubuntu/jammy multiverse]relion-cuda 3.1.0-2 [Ubuntu/jammy multiverse]relion-gui-cuda 3.1.0-2 [Ubuntu/jammy multiverse]tensorrt 8.4.3.1-1+cuda11.6 [NVIDIA CUDA/ ]tensorrt-dev 8.4.3.1-1+cuda11.6 [NVIDIA CUDA/ ]tensorrt-libs 8.4.3.1-1+cuda11.6 [NVIDIA CUDA/ ]uff-converter-tf 8.4.3-1+cuda11.6 [NVIDIA CUDA/ ]Seems versions match up, 11.7Would love some help! Did you got any help , I am facing the same issue .
2025-04-19ToolchainNVIDIA CUDA Toolkit (available at Microsoft Windows® operating systems:Microsoft Windows 11 21H2 (SV1)Microsoft Windows 11 22H2 (SV2)Microsoft Windows 11 23H2Microsoft Windows 10 22H2Microsoft Windows Server 2022Table 1 Windows Compiler Support in CUDA 12.6 Update 3Compiler*IDENative x86_64Cross-compilation (32-bit on 64-bit)C++ DialectMSVC Version 193xVisual Studio 2022 17.xYESNot supportedC++14 (default), C++17, C++20MSVC Version 192xVisual Studio 2019 16.xYESC++14 (default), C++17MSVC Version 191xVisual Studio 2017 15.x (RTW and all updates)YESC++14 (default), C++17* Support for Visual Studio 2015 is deprecated in release 11.1; support for Visual Studio 2017 is deprecated in release 12.5.32-bit compilation native and cross-compilation is removed from CUDA 12.0 and later Toolkit. Use the CUDA Toolkit from earlier releases for 32-bit compilation. CUDA Driver will continue to support running 32-bit application binaries on GeForce GPUs until Ada. Ada will be the last architecture with driver support for 32-bit applications. Hopper does not support 32-bit applications.Support for running x86 32-bit applications on x86_64 Windows is limited to use with:CUDA DriverCUDA Runtime (cudart)CUDA Math Library (math.h)1.2. About This DocumentThis document is intended for readers familiar with Microsoft Windows operating systems and the Microsoft Visual Studio environment. You do not need previous experience with CUDA or experience with parallel computation.2. Installing CUDA Development ToolsBasic instructions can be found in the Quick Start Guide. Read on for more detailed instructions.The setup of CUDA development tools on a system running the appropriate version of Windows consists of a few simple steps:Verify the system has a CUDA-capable GPU.Download the NVIDIA CUDA Toolkit.Install the NVIDIA CUDA Toolkit.Test that the installed
2025-03-26Execution.Processing times remain slow, suggesting CPU usage (e.g., encode time = 1510.90 ms / 2 runs).System InformationOS: Windows 11 (or specify your Windows version)GPU: NVIDIA GeForce RTX 2050 (Compute Capability 8.6)Driver Version: 571.96CUDA Version: 12.8whisper.cpp Version: 1.7.4Build Tool: Visual Studio 2022, CMake 3.5+Additional ContextI have verified that ggml-cuda.dll, cudart64_12.dll, and cublas64_12.dll are present in build\bin\Release.dumpbin /dependents ggml-cuda.dll shows dependencies on cudart64_12.dll and cublas64_12.dll.nvidia-smi output:Sat Mar 1 16:06:26 2025+-----------------------------------------------------------------------------------------+| NVIDIA-SMI 571.96 Driver Version: 571.96 CUDA Version: 12.8 ||-----------------------------------------+------------------------+----------------------+| GPU Name Driver-Model | Bus-Id Disp.A | Volatile Uncorr. ECC || Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. || | | MIG M. ||=========================================+========================+======================|| 0 NVIDIA GeForce RTX 2050 WDDM | 00000000:01:00.0 Off | N/A || N/A 44C P0 6W / 55W | 0MiB / 4096MiB | 0% Default || | | N/A |+-----------------------------------------------------------------------------------------+| Processes: || GPU GI CI PID Type Process name GPU Memory || ID ID Usage ||=========================================================================================|| No running processes found |+-----------------------------------------------------------------------------------------+I have tried using the environment variable $env:GGML_CUDA_FORCE_CUBLAS = "yes" without success.Possible Solutions TriedModified src/CMakeLists.txt to link ggml-cuda with whisper.Built multiple times, ensuring all DLLs are present.Updated NVIDIA driver and CUDA toolkit to the latest versions.Request for HelpCould you please advise on why CUDA is not being utilized and how to resolve this issue? I would appreciate any guidance or additional debugging steps to identify the root cause.
2025-04-05October 3, 2022, 3:33pm 1 Hello :)I’m facing the above error when trying to run deviceQuery. (I’m attempting to enable GPU acceleration on WSL2).All relevant info:./deviceQuery./deviceQuery Starting... CUDA Device Query (Runtime API) version (CUDART static linking)cudaGetDeviceCount returned 35-> CUDA driver version is insufficient for CUDA runtime versionResult = FAILnvidia-smi.exe+-----------------------------------------------------------------------------+| NVIDIA-SMI 517.40 Driver Version: 517.40 CUDA Version: 11.7 ||-------------------------------+----------------------+----------------------+| GPU Name TCC/WDDM | Bus-Id Disp.A | Volatile Uncorr. ECC || Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. || | | MIG M. ||===============================+======================+======================|| 0 NVIDIA GeForce ... WDDM | 00000000:01:00.0 On | N/A || 0% 49C P8 N/A / 72W | 221MiB / 4096MiB | 24% Default || | | N/A |+-------------------------------+----------------------+----------------------++-----------------------------------------------------------------------------+| Processes: || GPU GI CI PID Type Process name GPU Memory || ID ID Usage ||=============================================================================|| 0 N/A N/A 2556 C+G ...wekyb3d8bbwe\Video.UI.exe N/A || 0 N/A N/A 7720 C+G C:\Windows\explorer.exe N/A || 0 N/A N/A 8172 C+G ...5n1h2txyewy\SearchApp.exe N/A || 0 N/A N/A 8640 C+G ...y\ShellExperienceHost.exe N/A || 0 N/A N/A 9888 C+G ...2txyewy\TextInputHost.exe N/A || 0 N/A N/A 11584 C+G ...)\Surfshark\Surfshark.exe N/A || 0 N/A N/A 13380 C+G ...perience\NVIDIA Share.exe N/A || 0 N/A N/A 15724 C+G ...bbwe\Microsoft.Photos.exe N/A |+-----------------------------------------------------------------------------+wslfetchWindows Subsystem for Linux (WSL2)Build: 19043Branch: vb_releaseRelease: Ubuntu 22.04.1 LTSKernel: Linux 5.10.102.1-microsoft-standard-WSL2apt list | grep cudabart-cuda 0.7.00-5 [Ubuntu/jammy multiverse]boinc-client-nvidia-cuda 7.18.1+dfsg-4 [Ubuntu/jammy universe]cuda 11.7.1-1 [NVIDIA CUDA/ ]cuda-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-11-0 11.0.3-1 [NVIDIA CUDA/ ]cuda-11-1 11.1.1-1 [NVIDIA CUDA/ ]cuda-11-2 11.2.2-1 [NVIDIA CUDA/ ]cuda-11-3 11.3.1-1 [NVIDIA CUDA/ ]cuda-11-4 11.4.4-1 [NVIDIA CUDA/ ]cuda-11-5 11.5.2-1 [NVIDIA CUDA/ ]cuda-11-6 11.6.2-1 [NVIDIA CUDA/ ]cuda-11-7 11.7.1-1 [NVIDIA CUDA/ ]cuda-cccl-11-4 11.4.122-1 [NVIDIA CUDA/ ]cuda-cccl-11-5 11.5.62-1 [NVIDIA CUDA/ ]cuda-cccl-11-6 11.6.55-1 [NVIDIA CUDA/ ]cuda-cccl-11-7 11.7.91-1 [NVIDIA CUDA/ ]cuda-command-line-tools-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-command-line-tools-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-command-line-tools-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-command-line-tools-11-0 11.0.3-1 [NVIDIA CUDA/ ]cuda-command-line-tools-11-1 11.1.1-1 [NVIDIA CUDA/ ]cuda-command-line-tools-11-2 11.2.2-1 [NVIDIA CUDA/ ]cuda-command-line-tools-11-3 11.3.1-1 [NVIDIA CUDA/ ]cuda-command-line-tools-11-4 11.4.4-1 [NVIDIA CUDA/ ]cuda-command-line-tools-11-5 11.5.2-1 [NVIDIA CUDA/ ]cuda-command-line-tools-11-6 11.6.2-1 [NVIDIA CUDA/ ]cuda-command-line-tools-11-7 11.7.1-1 [NVIDIA CUDA/ ]cuda-compat-10-0 410.129-1 [NVIDIA CUDA/ ]cuda-compat-10-1 418.226.00-1 [NVIDIA CUDA/ ]cuda-compat-10-2 440.118.02-1 [NVIDIA CUDA/ ]cuda-compat-11-0 450.203.03-1 [NVIDIA CUDA/ ]cuda-compat-11-1 455.45.01-1 [NVIDIA CUDA/ ]cuda-compat-11-2 460.106.00-1 [NVIDIA CUDA/ ]cuda-compat-11-3 465.19.01-1 [NVIDIA CUDA/ ]cuda-compat-11-4 470.141.03-1 [NVIDIA CUDA/ ]cuda-compat-11-5 495.29.05-1 [NVIDIA CUDA/ ]cuda-compat-11-6 510.85.02-1 [NVIDIA CUDA/ ]cuda-compat-11-7 515.65.01-1 [NVIDIA CUDA/ ]cuda-compiler-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-compiler-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-compiler-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-compiler-11-0 11.0.3-1 [NVIDIA CUDA/ ]cuda-compiler-11-1 11.1.1-1 [NVIDIA CUDA/ ]cuda-compiler-11-2 11.2.2-1 [NVIDIA CUDA/ ]cuda-compiler-11-3 11.3.1-1 [NVIDIA CUDA/ ]cuda-compiler-11-4 11.4.4-1 [NVIDIA CUDA/ ]cuda-compiler-11-5 11.5.2-1 [NVIDIA CUDA/ ]cuda-compiler-11-6 11.6.2-1 [NVIDIA CUDA/ ]cuda-compiler-11-7 11.7.1-1 [NVIDIA CUDA/ ]cuda-core-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-core-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-core-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-cross-qnx 10.0.130-1 [NVIDIA CUDA/ ]cuda-cross-qnx-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-cublas-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-cublas-dev-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-cudart-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-cudart-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-cudart-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-cudart-11-0 11.0.221-1 [NVIDIA CUDA/ ]cuda-cudart-11-1 11.1.74-1 [NVIDIA CUDA/ ]cuda-cudart-11-2 11.2.152-1 [NVIDIA CUDA/ ]cuda-cudart-11-3 11.3.109-1 [NVIDIA CUDA/ ]cuda-cudart-11-4 11.4.148-1 [NVIDIA CUDA/ ]cuda-cudart-11-5 11.5.117-1 [NVIDIA CUDA/ ]cuda-cudart-11-6 11.6.55-1 [NVIDIA CUDA/ ]cuda-cudart-11-7 11.7.99-1 [NVIDIA CUDA/ ]cuda-cudart-dev-10-0 10.0.130-1 [NVIDIA CUDA/ ]cuda-cudart-dev-10-1 10.1.243-1 [NVIDIA CUDA/ ]cuda-cudart-dev-10-2 10.2.89-1 [NVIDIA CUDA/ ]cuda-cudart-dev-11-0 11.0.221-1 [NVIDIA CUDA/ ]cuda-cudart-dev-11-1 11.1.74-1
2025-04-21Skip to content Navigation Menu GitHub Copilot Write better code with AI Security Find and fix vulnerabilities Actions Automate any workflow Codespaces Instant dev environments Issues Plan and track work Code Review Manage code changes Discussions Collaborate outside of code Code Search Find more, search less Explore Learning Pathways Events & Webinars Ebooks & Whitepapers Customer Stories Partners Executive Insights GitHub Sponsors Fund open source developers The ReadME Project GitHub community articles Enterprise platform AI-powered developer platform Pricing Provide feedback Saved searches Use saved searches to filter your results more quickly //voltron/issues_fragments/issue_layout;ref_cta:Sign up;ref_loc:header logged out"}"> Sign up Notifications You must be signed in to change notification settings Fork 4k Star 38.7k DescriptionDescriptionI am trying to use whisper-cli.exe with CUDA support on Windows to leverage my NVIDIA GeForce RTX 2050 GPU, but the application is not utilizing CUDA (showing CUBLAS = 0 in system_info). Despite following the instructions in the README and making the suggested changes, the program continues to run on the CPU instead of the GPU.Steps to ReproduceInstalled CUDA Toolkit 12.8 from and NVIDIA driver version 571.96 (confirmed via nvidia-smi).Cloned the whisper.cpp repository (version 1.7.4) and navigated to the directory:cd C:\Users\carwy\Downloads\Compressed\whisper.cpp-1.7.4\whisper.cpp-1.7.4Built the project with CUDA support:cmake -B build -DGGML_CUDA=1 -DCMAKE_BUILD_TYPE=Release -DCMAKE_CUDA_ARCHITECTURES=native -DCUDAToolkit_ROOT="C:/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v12.8"cmake --build build --config Release --verboseEnsured all necessary DLLs (ggml-cuda.dll, cudart64_12.dll, cublas64_12.dll) are in build\bin\Release.Modified src/CMakeLists.txt to include:if (GGML_CUDA)target_link_libraries(whisper PRIVATE ggml-cuda)endif()Ran the following command:.\whisper-cli.exe -m "C:\Users\carwy\Desktop\SubtitleApp\SubtitleApp Backupw\SubtitleApp\CoreAssets\Window\ggml-large-v3-turbo-q8_0.bin" -f "C:\Users\carwy\Downloads\Thoi gian troi qua that nhanh.wav"Expected Behaviorsystem_info in the output should show CUBLAS = 1, indicating CUDA is being used.GPU usage should increase (visible in nvidia-smi), and processing times (whisper_print_timings) should be significantly faster on the NVIDIA GeForce RTX 2050.Actual Behaviorsystem_info shows CUBLAS = 0:system_info: n_threads = 4 / 12 | AVX = 1 | AVX2 = 1 | AVX512 = 0 | FMA = 1 | NEON = 0 | ARM_FMA = 0 | F16C = 1 | FP16_VA = 0 | WASM_SIMD = 0 | SSE3 = 1 | SSSE3 = 1 | VSX = 0 | COREML = 0 | OPENVINO = 0 |nvidia-smi shows 0% GPU utilization and 0MiB memory usage during
2025-04-01