Samples for CUDA Developers which demonstrates features in CUDA Toolkit
-
Updated
Mar 12, 2025 - C
#
cuda-kernels
Here are 219 public repositories matching this topic...
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
llama cuda-kernels deepspeed llm fastertransformer llm-inference turbomind internlm llama2 codellama llama3
-
Updated
Mar 14, 2025 - Python
📚200+ Tensor/CUDA Cores Kernels, ⚡️flash-attn-mma, ⚡️hgemm with WMMA, MMA and CuTe (98%~100% TFLOPS of cuBLAS/FA2 🎉🎉).
cuda cuda-kernels cutlass cudnn cuda-toolkit gemm cuda-programming gemv hgemm flash-attention flash-mla
-
Updated
Mar 14, 2025 - Cuda
Deep learning in Rust, with shape checked tensors and neural networks
rust machine-learning deep-neural-networks deep-learning neural-network gpu cuda autograd rust-lang gpu-acceleration cuda-kernels tensor gpu-computing backpropagation cudnn cuda-toolkit cuda-support autodiff autodifferentiation
-
Updated
Jul 23, 2024 - Rust
CUDA Core Compute Libraries
cpp hpc gpu modern-cpp parallel-computing cuda nvidia gpu-acceleration cuda-kernels gpu-computing parallel-algorithm parallel-programming nvidia-gpu gpu-programming cuda-library cpp-programming cuda-programming accelerated-computing cuda-cpp
-
Updated
Mar 14, 2025 - C++
Safe rust wrapper around CUDA toolkit
rust gpu cuda cublas gpu-acceleration cuda-kernels cudnn cuda-toolkit nccl curand cuda-programming nvrtc
-
Updated
Mar 12, 2025 - Rust
CUDA Kernel Benchmarking Library
-
Updated
Mar 12, 2025 - Cuda
Simple utilities to enable code reuse and portability between CUDA C/C++ and standard C/C++.
-
Updated
Apr 14, 2022 - C++
Kernel Tuner
python c testing machine-learning cplusplus gpu optimization opencl cuda autotuning software-development opencl-kernels kernel-tuner cuda-kernels gpu-computing auto-tuning
-
Updated
Mar 13, 2025 - Python
This is an archive of materials produced for an introductory class on CUDA programming at Stanford University in 2010
-
Updated
Jun 24, 2022 - C++
From zero to hero CUDA for accelerating maths and machine learning on GPU.
-
Updated
Jul 23, 2024 - Cuda
Amplifier allows .NET developers to easily run complex applications with intensive mathematical computation on Intel CPU/GPU, NVIDIA, AMD without writing any additional C kernel code. Write your function in .NET and Amplifier will take care of running it on your favorite hardware.
-
Updated
Dec 8, 2022 - C#
Some CUDA design patterns and a bit of template magic for CUDA
-
Updated
Jun 3, 2023 - C++
Spiking Neural Networks in C++ with strong GPU acceleration through CUDA
-
Updated
Jul 3, 2020 - Cuda
Open source cross-platform compiler for compute-intensive loops used in AI algorithms, from Microsoft Research
research cross-platform compiler python-library machine-learning-algorithms gpu-acceleration cross-compiler cuda-kernels tuning-parameters optimization-framework cpu-scheduling loop-unrolling loop-fusion loop-scheduling rocm-kernel
-
Updated
Oct 10, 2023 - C++
CUDA kernel author's tools
patterns algorithms gpu constexpr modern-cpp cuda printf cpp11 utility-library cuda-kernels gpu-programming cuda-library elegant-coding cuda-programming utility-functions printf-functions
-
Updated
Apr 24, 2022 - Cuda
High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
-
Updated
Jul 13, 2024 - Cuda
Triton implementation of FlashAttention2 that adds Custom Masks.
deep-learning triton attention cuda-kernels attention-mechanism triton-lang flash-attention flash-attention-2
-
Updated
Aug 14, 2024 - Python
A tool for examining GPU scheduling behavior.
-
Updated
Aug 17, 2024 - Cuda
TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing. By providing a higher-level interface, algorithm developers can design hardware-aware algorithms without dealing with low-level hardware complexities.
-
Updated
Mar 11, 2025 - Cuda
Improve this page
Add a description, image, and links to the cuda-kernels topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the cuda-kernels topic, visit your repo's landing page and select "manage topics."