Package for running Nvidia Triton within python test with features like Dockerfile DSL and building images on fly.

Learnings and experimentation with GPU programming

A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.

Packer plugin for Triton Builder

🐳 Scripps Whale Acoustics Lab 🌎 Scripps Acoustic Ecology Lab - Triton with remoras in development

Linux kernel module to support Turbo mode and RGB Keyboard for Acer Predator notebook series

Efficient kernel for RMS normalization with fused operations, includes both forward and backward passes, compatibility with PyTorch.

ClearML - Model-Serving Orchestration and Repository Solution

Deploy DL/ ML inference pipelines with minimal extra code.

`torch.compile`-compatible image binarization algorithm implemented in PyTorch.

Hardware-accelerated, deep learned model support for object detection including YOLOv8 and DetectNet

LAMB go brrr

Binary Ninja plugin that can be used to apply Triton's dead store eliminitation pass on basic blocks or functions.

MLModelService wrapping Nvidia's Triton Server

This bootcamp is designed to give NLP researchers an end-to-end overview on the fundamentals of NVIDIA NeMo framework, complete solution for building large language models. It will also have hands-on exercises complimented by tutorials, code snippets, and presentations to help researchers kick-start with NeMo LLM Service and Guardrails.

Flash linear attention kernels in Triton

Ozoz dotfiles for bspwm, i3WM

Kernl lets you run PyTorch transformer models several times faster on GPU with a single line of code, and is designed to be easily hackable.

삼각형의 실전! Triton

Triton backend for managing the model state tensors automatically in sequence batcher