Skip to content
This repository has been archived by the owner on Jan 24, 2024. It is now read-only.

Issues: hyperonym/basaran

Support for v1/embeddings endpoint
#179 by josephrocca was closed Jun 3, 2023
Closed 12
Add support for chat completion API
#140 opened Apr 16, 2023 by peakji
Open 1
32 Open 27 Closed
32 Open 27 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

401 error on llama2 model while access granted question Further information is requested
#289 opened Dec 16, 2023 by tomtomtomtom44
Runpod Serverless question Further information is requested
#288 opened Dec 15, 2023 by stonejohnson
1
Loading basaran on multiple gpus leads to error question Further information is requested
#280 opened Nov 30, 2023 by tanmaylaud
Can you create a Gradio app for this Trained model
#276 opened Nov 14, 2023 by yhammadmufin
Suggestion: Passthrough to OpenAI GPT3.5 for testing
#273 opened Nov 1, 2023 by FetchFast
Tried multiple different models but get "The model weights are not tied..." error every time.. question Further information is requested
#266 opened Sep 30, 2023 by jontstaz
Strong need for multiple models in a single deployment enhancement New feature or request
#263 opened Sep 21, 2023 by KastanDay
3
Use basaran API as Langchain LLM question Further information is requested
#256 opened Sep 8, 2023 by brightebyte
TypeError: issubclass() arg 1 must be a class bug Something isn't working
#253 opened Sep 4, 2023 by gsuuon
1
How to send Audio Inputs to the Basaran enhancement New feature or request
#234 opened Jul 27, 2023 by Tushar-ml
@Tushar-ml
3
Llama 2 models not working - how to pass auth token? enhancement New feature or request
#232 opened Jul 21, 2023 by arsaboo
1
TypeError: __init__() got an unexpected keyword argument 'load_in_4bit' question Further information is requested
#227 opened Jul 11, 2023 by tanshuai
1
FR support for using fine tuned models that use Peft enhancement New feature or request
#221 opened Jul 3, 2023 by samos123
I want use the function prefix_allowed_tokens_fn, where of basaran's source code shall I modify? question Further information is requested
#220 opened Jun 29, 2023 by zoubaihan
1
RuntimeError: expected scalar type Float but found Half question Further information is requested
#215 opened Jun 16, 2023 by DataDropp
crash when running mosaicml/mpt-7b-* models: KeyError: 'attention_mask' bug Something isn't working
#213 opened Jun 12, 2023 by tarasglek
2
Falcon 40B : too slow and random answers question Further information is requested
#204 opened Jun 6, 2023 by ArnaudHureaux
@fardeon
7
Langchain Prompt Format bug Something isn't working enhancement New feature or request
#198 opened Jun 1, 2023 by 0xDigest
@peakji @fardeon
5
in stream mode, the English word has no space after detokenizer and Chinese were messed up question Further information is requested
#197 opened Jun 1, 2023 by lucasjinreal
14
How to set my own parameters in model.generate() in basaran? question Further information is requested
#193 opened May 17, 2023 by zoubaihan
2
Do you have Discord community? question Further information is requested
#185 opened Apr 25, 2023 by karfly
1
Docker run runs and then exits, does not set up server dependencies Pull requests that update a dependency file help wanted Extra attention is needed
#183 opened Apr 25, 2023 by handrew
2
RuntimeError: mat1 and mat2 shapes cannot be multiplied bug Something isn't working duplicate This issue or pull request already exists
#181 opened Apr 24, 2023 by lcw99
1
GPTQ & 4bit duplicate This issue or pull request already exists
#180 opened Apr 22, 2023 by olihough86
3
The requested URL was not found on the server help wanted Extra attention is needed
#151 opened Apr 18, 2023 by artivis
2
ProTip! Exclude everything labeled bug with -label:bug.