vmap Basics
Richard Zou edited this page Dec 19, 2022
·
2 revisions
Page Maintainers: @zou3519
- Understand what vmap is
- Understand how vmap is implemented with Tensor Subclassing
- Understand (as a PyTorch developer) how to add missing support for an operation with vmap
Read through the functorch whirlwind tour.
Read through https://github.com/pytorch/pytorch/blob/master/functorch/writing_batching_rules.md
- Install Prerequisites
- Fork, clone, and checkout the PyTorch source
- Install Dependencies
- Build PyTorch from source
- Tips for developing PyTorch
- PyTorch Workflow Git cheatsheet
- Overview of the Pull Request Lifecycle
- Finding Or Reporting Issues
- Pre Commit Checks
- Create a Pull Request
- Typical Pull Request Workflow
- Pull Request FAQs
- Getting Help
- Codebase structure
- Tensors, Operators, and Testing
- Autograd
- Dispatcher, Structured Kernels, and Codegen
- torch.nn
- CUDA basics
- Data (Optional)
- function transforms (Optional)