Discussions

• 2 You must be logged in to vote

  🗳️

  Is llm still necessary, and should development still continue?

  philpax started Oct 24, 2023 in Polls · Closed

  

  

  

  

  13
• 1 You must be logged in to vote

  🗳️

  Should we rename to rllm?

  philpax started Sep 5, 2023 in Polls · Closed

  

  

  

  

  4
• 1 You must be logged in to vote

  💬

  Instructions for llm-cli obsolete?

  MSSRPRAD started Aug 16, 2023 in General · Closed

  

  

  2
• 1 You must be logged in to vote

  🙏

  Llama 2 Models?

  arghyadipchak asked Jul 19, 2023 in Q&A · Closed · Answered

  

  

  2
• 1 You must be logged in to vote

  🙌

  A tool to convert from pytorch pickle file

  iacore started Jul 1, 2023 in Show and tell

  

  

  0
• 1 You must be logged in to vote

  🙌

  A path to adding more types of samplers, including Mirostat 1 and 2

  KerfuffleV2 started Jun 22, 2023 in Show and tell · Closed

  

  

  1
• 1 You must be logged in to vote

  💬

  Direct link to *.bin in docs?

  stnbu started Jun 28, 2023 in General

  

  

  

  

  4
• 1 You must be logged in to vote

  💡

  Loading "unaligned" models with proper alignment

  iacore started May 22, 2023 in Ideas · Closed

  

  

  2
• 1 You must be logged in to vote

  💡

  Run (New) 5-bit Quantized Models

  PeytonCleveland started May 17, 2023 in Ideas · Closed

  

  

  4
• 1 You must be logged in to vote

  💬

  Debugging performance

  pdufour started May 29, 2023 in General · Closed

  

  

  

  

  3
• 1 You must be logged in to vote

  🙏

  Ways to create infinite context?

  Panakotta00 asked May 25, 2023 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  Stable Model Format

  iacore started Apr 19, 2023 in General

  

  

  

  

  20
• 1 You must be logged in to vote

  💡

  Roadmap for multiple backends and dealing with quantization format changes

  philpax started May 21, 2023 in Ideas

  

  

  

  

  3
• 1 You must be logged in to vote

  🙏

  Is it possible to infer this model - https://huggingface.co/HuggingFaceH4/starchat-alpha

  Partysun asked May 17, 2023 in Q&A · Closed · Unanswered

  

  

  1
• 4 You must be logged in to vote

  💬

  Scheduling of upcoming PRs

  philpax started Apr 7, 2023 in General · Closed

  

  

  

  

  14
• 1 You must be logged in to vote

  💡

  Binding to llama.cpp

  shadowmint started Apr 9, 2023 in Ideas

  

  

  

  

  10
• 3 You must be logged in to vote

  📣

  Welcome to llama-rs Discussions!

  philpax announced Mar 24, 2023 in Announcements

  

  

  1
• 1 You must be logged in to vote

  💬

  Let's collaborate

  philpax started Mar 14, 2023 in General

  

  

  

  

  13