Skip to content

Issues: microsoft/onnxruntime-genai

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

38 Open 60 Closed
38 Open 60 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Phi-3-mini-4k-instruct-onnx model generates nonsensical results when prompt is longer than half of the context window length
#552 opened May 31, 2024 by jackylu0124
DirectML error when input is longer than half of the maximum context length
#549 opened May 31, 2024 by jackylu0124
AttributeError: module 'onnxruntime_genai' has no attribute 'Model'
#547 opened May 30, 2024 by iwaitu
1
Inspect GeneratorParams (and possible other class) in C# & Java enhancement New feature or request
#545 opened May 30, 2024 by skyline75489
Support Llama / Hugging Face's Universal Format (GGUF)
#543 opened May 30, 2024 by BrainSlugs83
Is OgaGenerator a one-time object?
#538 opened May 29, 2024 by MasterYi1024
@yufenglee
2
pip install --pre onnxruntime-genai
#535 opened May 29, 2024 by yeyujujishou
2
AttributeError due to a lack of default value in phi3-qa.py
#533 opened May 28, 2024 by romanows
3
ONNXRuntime-genai doesn't release GPU memory after first inference
#526 opened May 28, 2024 by Positronx
Unknown value: inputs_embeds bug Something isn't working
#525 opened May 28, 2024 by eres313
7
Questions about the temperature config in search options and its unexpected/incorrect behavior
#524 opened May 27, 2024 by jackylu0124
Can I use onnxruntime-genai with a grammar for output like llama.cpp?
#523 opened May 27, 2024 by han-minhee
ERROR: "The parameter is incorrect." when running phi3 DML C example on Windows 10
#521 opened May 25, 2024 by MajorPainTheCactus
[Feature Request] phi-3-small-128k-onnx-cpu model
#519 opened May 24, 2024 by Ben-Epstein
1
cannot install onnxruntime-genai on CPU based, Intel Mac
#518 opened May 24, 2024 by sivang
3
segmentation fault when running long sequence input to Phi3-128k-instruct-onnx
#515 opened May 24, 2024 by houminmin
2
How to implement support for concurrency?
#505 opened May 23, 2024 by CharlinChen
2
With Latest GeForce Driver v555 - Microsoft.ML.OnnxRuntimeGenAI.OnnxRuntimeGenAIException: The GPU will not respond to more commands, most likely because of an invalid command passed by the calling application.
#501 opened May 22, 2024 by AshD
9
ONNXRuntime genai fine tuning
#500 opened May 22, 2024 by Positronx
5
[Mobile] System.DllNotFoundException "onnxruntime-genai" when debugging on Android
#496 opened May 22, 2024 by GuiOliv
1
[Mobile] System.DllNotFoundException "onnxruntime-genai" when debugging on Android
#504 opened May 22, 2024 by GuiOliv
1
Errors when running Phi-3 on NVIDIA CUDA with onnxruntime_genai
#490 opened May 21, 2024 by jackylu0124
7
Device API throws exception
#488 opened May 21, 2024 by natke
1
Feature Request: Specify seed in python SDK
#463 opened May 15, 2024 by Ben-Epstein
1
Model for llama-3-8B, EP: cpu, precision: int4 generated using onnxruntime-genai/src/python/py/models/builder.py has issues
#462 opened May 15, 2024 by jmopuri
4
ProTip! Exclude everything labeled bug with -label:bug.