Discussions

• 1 You must be logged in to vote

  🙏

  Can't convert torchvision MaskRCNN model to TensorRT

  nxlitvin asked Nov 1, 2023 in Q&A · Unanswered

  

  

  

  

  13
• 1 You must be logged in to vote

  #️⃣

  CUDAGraphs in Torch-TRT

  gs-olive started Apr 9, 2024 in RFCs

  

  

  0
• 1 You must be logged in to vote

  🙏

  Support for loading multiple LORA adapters at runtime

  naiveen asked Feb 26, 2024 in Q&A · Unanswered

  

  

  2
• 1 You must be logged in to vote

  🙏

  Fails intermittently when intermediate layers produce large tensors

  naiveen asked Feb 29, 2024 in Q&A · Closed · Unanswered

  

  

  1
• 2 You must be logged in to vote

  🙌

  Torch-TensorRT v2.2.0

  narendasan started Feb 14, 2024 in Show and tell

  

  

  0
• 1 You must be logged in to vote

  #️⃣

  Dynamic shapes support for tensorrt backend in torch.compile

  peri044 started Feb 2, 2024 in RFCs

  

  

  1
• 1 You must be logged in to vote

  💬

  release torch-tensorrt >= v2.1.0

  bjaeger1 started Feb 5, 2024 in General · Closed

  

  

  0
• 3 You must be logged in to vote

  🙏

  ❓ [Question] How do you convert part of the model to TRT?

  question Further information is requested

  MarekPokropinski asked Feb 18, 2022 in Q&A · Unanswered

  

  

  

  

  5
• 1 You must be logged in to vote

  🙏

  Converting classification model from pytorch to onnx to tensorrt , and following tensorrt pynb for inference and using tensorrt 8.6

  Abiganesh asked Dec 13, 2023 in Q&A · Unanswered

  

  

  1
• 2 You must be logged in to vote

  ⚙️

  Torch-TensorRT Dynamo Design Documentation for Developers

  gs-olive started Nov 17, 2023 in Internals

  

  

  2
• 2 You must be logged in to vote

  #️⃣

  INT8 support in dynamo workflows

  peri044 started Nov 13, 2023 in RFCs

  

  

  0
• 1 You must be logged in to vote

  #️⃣

  Dynamic shapes for torch.export

  peri044 started Oct 23, 2023 in RFCs

  

  

  2
• 1 You must be logged in to vote

  ⚙️

  aten.linear Performance Benchmarking + Exploration

  gs-olive started Sep 5, 2023 in Internals

  

  

  

  

  6
• 1 You must be logged in to vote

  🙏

  ❓ [Question] Is there a way to visualize the TRT model?

  question Further information is requested

  Scass0807 asked Dec 21, 2021 in Q&A · Unanswered

  

  

  

  

  6
• 1 You must be logged in to vote

  #️⃣

  Export serialization

  peri044 started Aug 4, 2023 in RFCs

  

  

  1
• 2 You must be logged in to vote

  ⚙️

  Torch-TensorRT 2.0

  narendasan started Apr 14, 2023 in Internals

  

  

  

  

  9
• 3 You must be logged in to vote

  💬

  INT8/Quantization in torch-TensorRT 1.4

  chichun-charlie-liu started Jul 7, 2023 in General

  

  

  1
• 1 You must be logged in to vote

  #️⃣

  aten Converter Capabilities Scoping

  gs-olive started Jun 28, 2023 in RFCs

  

  

  4
• 1 You must be logged in to vote

  #️⃣

  Dynamo TorchBench Integration Plan

  gs-olive started Jun 26, 2023 in RFCs

  

  

  0
• 1 You must be logged in to vote

  ⚙️

  Improvements to Dynamo/TRT Workflow

  gs-olive started Mar 17, 2023 in Internals

  

  

  1
• 1 You must be logged in to vote

  #️⃣

  Dynamic shape support in dynamo

  peri044 started Jun 12, 2023 in RFCs

  

  

  

  

  2
• 1 You must be logged in to vote

  🙏

  torch.autograd.grad

  kudoryutaro asked Jun 13, 2023 in Q&A · Unanswered

  

  

  1
• 2 You must be logged in to vote

  🙏

  RunTimeError for dimension specs

  harrismathew asked May 1, 2023 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  #️⃣

  Shape Tensor handling in conversion and design for dynamic converters

  peri044 started Apr 19, 2023 in RFCs

  

  

  

  

  4
• 1 You must be logged in to vote

  🙌

  Torch-TensorRT v1.0.0

  narendasan started Nov 9, 2021 in Show and tell

  

  

  

  

  6