Discussions

• 1 You must be logged in to vote

  🙏

  Clarification for the precision part in fp8_primer

  YangFei1990 asked May 4, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  Could you share any papers/books that provide underlying explanations for this project?

  nicks64 started Apr 24, 2024 in General

  

  

  

  

  4
• 1 You must be logged in to vote

  🙏

  Can this module be used for training on an Ada GPU?

  scissorstail asked Apr 11, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  [Pytorch] Is the fwd_amx_history of first module is used before required allreduce communication

  mst9009 started Mar 18, 2024 in General

  

  

  0
• 1 You must be logged in to vote

  🙏

  te.Embedding layer?

  sopotc asked Feb 13, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  What is the data type in AllReduce？

  MARD1NO asked Sep 11, 2023 in Q&A · Closed · Unanswered

  

  

  0
• 2 You must be logged in to vote

  💬

  Official example for multi-GPU training didn't work on 4090

  QIU-Shuo started Aug 18, 2023 in General

  

  

  0
• 1 You must be logged in to vote

  🙏

  FP8 format

  stella-jxu asked Jun 8, 2023 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Enabling sequence_parallel slows down training with fp16

  cavdard asked Apr 27, 2023 in Q&A · Answered

  

  

  

  

  8
• 1 You must be logged in to vote

  🙏

  [Question] What is the memory footprint of te.Linear() weights ?

  vince62s asked May 16, 2023 in Q&A · Answered

  

  

  1
• 0 You must be logged in to vote

  🙏

  Latency/Energy Calculation

  krishnateja95 asked May 17, 2023 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  How does TransformerEngine interact with TensorRT/Onnx?

  tylerweitzman asked May 10, 2023 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  How to run LLaMa inference?

  SinanAkkoyun asked May 9, 2023 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  FP8 questions...

  vgoklani asked Apr 4, 2023 in Q&A · Answered

  

  

  3