Discussions

• 1 You must be logged in to vote

  💬

  how much vram could LLaMa 3 400B model require to be trained for chinese llama type training ?

  StephennFernandes started Apr 19, 2024 in General

  

  

  0
• 1 You must be logged in to vote

  🙏

  打造精准回复的问答机器人的问题

  ILG2021 asked Apr 4, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  在privateGPT上加载中文文档，报字符集错误，请问如何解决

  LiuPalin asked Mar 9, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  请问下tokenizer会开放吗？如果不开放，有没有推荐的tokenizer

  xj260098061 started Mar 7, 2024 in General

  

  

  1
• 1 You must be logged in to vote

  🙏

  能用Chinese-LLaMA-Alpaca-2 做基座，然后扩充蒙古文词表，蒙古文语料上增量训练，蒙汉平行语料指令微调实现蒙古文LLM吗？

  fandaoerji asked Mar 6, 2024 in Q&A · Answered

  

  

  6
• 1 You must be logged in to vote

  🙏

  本项目支持从头训练吗？

  wudi-7mi asked Jan 21, 2024 in Q&A · Answered

  

  

  

  

  6
• 1 You must be logged in to vote

  🙏

  使用colab T4GPU预训练Chinese-LLaMA-Alpaca-2，执行run_pt.sh，报错（着急解决！）

  KagerJin asked Feb 23, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  chinese-alpaca2-1.3b进行增量预训练后的模型合并

  azyu11 asked Feb 21, 2024 in Q&A · Answered

  

  

  2
• 1 You must be logged in to vote

  🙏

  “基座模型”和“指令模型”该怎么使用？

  kgdxpr asked Feb 6, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  模型合并转换基础模型选择

  afpro asked Aug 1, 2023 in Q&A · Answered

  

  

  

  

  2
• 1 You must be logged in to vote

  💬

  About PT

  Henry-Joen started Jan 31, 2024 in General

  

  

  2
• 2 You must be logged in to vote

  🙏

  关于llama 仿openai_api的调用

  HelloEveryonehh asked Jan 31, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  怎么把模型转成ollama的模型,how to convert model to ollama

  wangchao1980 started Oct 24, 2023 in General

  

  

  

  

  3
• 0 You must be logged in to vote

  🙏

  模型怎么调用啊？

  TeddyTang11 asked Jan 23, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Run 13B Alpaca Llama Failed

  PeterFujiyu asked Jan 27, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  💬

  About v4.1

  Henry-Joen started Jan 24, 2024 in General

  

  

  2
• 1 You must be logged in to vote

  💬

  预训练资料准备问题

  MonetCH started Jan 23, 2024 in General · Closed

  

  

  1
• 1 You must be logged in to vote

  💬

  我可以用chinese-llama-2-1.3b基座模型进行预训练吗？

  coffeefoam started Jan 18, 2024 in General

  

  

  0
• 0 You must be logged in to vote

  🙏

  DeepSpeed zero3

  Abolfazl-kr asked Dec 12, 2023 in Q&A · Unanswered

  

  

  

  

  5
• 1 You must be logged in to vote

  🙏

  请问二代模型可以像一代一样通过扩充词表和指令微调来实现对新语言的理解呢？

  SQJKL asked Aug 3, 2023 in Q&A · Unanswered

  

  

  

  

  6
• 3 You must be logged in to vote

  💬

  [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 128, reducing to 64

  dopu2k16 started Sep 3, 2023 in General · Closed

  

  

  

  

  7
• 1 You must be logged in to vote

  🙏

  如何使用AMD显卡进行微调？

  purefire asked Dec 27, 2023 in Q&A · Unanswered

  

  

  2
• 1 You must be logged in to vote

  💬

  竞技场指令收集与反馈（8月8日更新）

  ymcui started Jul 31, 2023 in General

  

  

  6
• 2 You must be logged in to vote

  📣

  中文羊驼大模型二期 v4.0

  ymcui announced Dec 29, 2023 in Announcements

  

  

  1
• 1 You must be logged in to vote

  🙏

  扩充词表后预训练的问题

  LiDChiang asked Dec 21, 2023 in Q&A · Unanswered

  

  

  1