Skip to content

Pull requests: karpathy/llm.c

New pull request New
50 Open 250 Closed
50 Open 250 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Zero update
#421 opened May 16, 2024 by ngc92 Loading…
(optionally) recompute gelu activations to reduce activation memory
#420 opened May 16, 2024 by ngc92 Loading…
1
Include a matmul_backward_bias kernel based on PMPP CoarsenedSumReduction kernel in 10.15
#419 opened May 16, 2024 by lancerts Loading…
4
Deterministic backward bias
#418 opened May 15, 2024 by ngc92 Loading…
Remove parallel CUDA streams while keeping main_stream and loss_event(?)
#417 opened May 15, 2024 by ademeure Loading…
Setting up dev/cpu area with the first matmul_forward.c
#416 opened May 15, 2024 by azret Loading…
Adding Mersenne Twisters Impl.
#414 opened May 15, 2024 by azret Loading…
Add support for AMD devices
#413 opened May 14, 2024 by anthonix Loading…
1
considerably speed up CPU matmul
#411 opened May 14, 2024 by ngc92 Loading…
6
Make ceil_div constexpr and inline
#404 opened May 12, 2024 by lancerts Loading…
Autodetect GPU compute capability using nvidia-smi.
#388 opened May 8, 2024 by akulchik Loading…
1
4
Free cooperative groups implementation of online softmax forward
#383 opened May 8, 2024 by KarhouTam Loading…
WikiText103 eval, attempt to reproduce Alec table posted on Reddit
#374 opened May 6, 2024 by karpathy • Draft
4
Modified version of ademeure's fused gelu_forward kernel
#363 opened May 5, 2024 by ChrisDryden Loading…
1
Overlap gradient computation and NCCL AllReduce
#361 opened May 5, 2024 by PeterZhizhin Loading…
Experimenting with global instantiation for the layouts
#347 opened May 3, 2024 by ChrisDryden • Draft
GPU auto-detect capability for kernel builds
#341 opened May 3, 2024 by rosslwheeler Loading…
6
Adding GPT2 model evaluation on WikiText-103 with optional preprocessing in dev/model-eval/
#340 opened May 3, 2024 by joeshmoe0112358 Loading…
2
GELU Fusion with cuBLASLt (SLOWER because it only merges in FP16 mode, not BF16/FP32...)
#338 opened May 3, 2024 by ademeure • Draft
Added FlameGraphs for nsys reports and some nsys documentation
#333 opened May 2, 2024 by PeterZhizhin Loading…
2
convert all float to floatX for layernorm_forward
#319 opened May 1, 2024 by JaneIllario Loading…
gradient clipping by global norm
#315 opened May 1, 2024 by ngc92 Loading…
Improve tanh derivative in backward gelu
#307 opened Apr 30, 2024 by akbariyeh Loading…
1
Updated adamw to use packed data types
#303 opened Apr 30, 2024 by ChrisDryden Loading…
17
Rewrite the encoder_forward float4 kernel with pack128
#302 opened Apr 30, 2024 by lancerts Loading…
ProTip! Type g i on any issue or pull request to go back to the issue listing page.