Skip to content

Issues: microsoft/onnxruntime-genai

MAIN BRANCH CONTAINS API CHANGES
#1142 opened Dec 11, 2024 by aciddelgado
Open 3
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

79 Open 273 Closed
79 Open 273 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

onnx.checker.check_model("phi-3.5-v-instruct-vision.onnx") Error
#1276 opened Feb 24, 2025 by jason-engage
Load tokenizer error when path contains special character
#1262 opened Feb 19, 2025 by ssss141414
5
how to create the whisper model to run with genai?
#1261 opened Feb 19, 2025 by andyt9527
1
Support for DeepSeek-R1-Distilled-NPU-Optimized model that comes with AI Toolkit
#1258 opened Feb 15, 2025 by max-krasnyansky
3
generator.ComputeLogits run errors ep:DML
#1241 opened Feb 11, 2025 by Gusha-nye
2
Setting a temperature does not give varying output
#1237 opened Feb 10, 2025 by Nittur
5
Safe practice to mitigate prompt injection?
#1235 opened Feb 9, 2025 by ghost-24765
1
Cant add multiple images for conversation in c#
#1233 opened Feb 8, 2025 by Barshan-Mandal
Microsoft.ML.OnnxRuntimeGenAI.OnnxRuntimeGenAIException: 'CUDA execution provider is not enabled in this build.' ep:CUDA
#1191 opened Jan 16, 2025 by karayakar
11
C# Run Program on NPU (OnnxRuntime + DirectML + NPU)? ep:DML
#1189 opened Jan 16, 2025 by Gusha-nye
2
Can't infer Qwen2-1.5B with a lora
#1186 opened Jan 15, 2025 by busishengui
5
[DML] Using Olive generated adapters throws Data transfer is not available for the specified device allocator error ep:DML
#1181 opened Jan 13, 2025 by ambroser53
3
can't infer with a "exclude_lm_head" model
#1166 opened Jan 6, 2025 by busishengui
@kunal-vaishnavi
3
Not able to run Exclude-Embed models api:java
#1163 opened Dec 24, 2024 by balachandarsv
3
C examples refer to 0.4.0 in rel-0.5.2 documentation and samples Improvements or additions to documentation
#1157 opened Dec 17, 2024 by natke
1
MAIN BRANCH CONTAINS API CHANGES 0.6.0 bug Something isn't working question Further information is requested release
#1142 opened Dec 11, 2024 by aciddelgado
3
[Linux] [C#] [0.5.2] Publish/Build Binaries with Microsoft.ML.OnnxRuntimeGenAI.Cuda on Linux containing unnecessary large DLL files ep:CUDA
#1135 opened Dec 10, 2024 by jiaxuwu2021
6
.Net How to free GPU memory after each inference bug Something isn't working enhancement New feature or request performance
#1131 opened Dec 9, 2024 by strikene
5
Receiving ROCm execution provider not supported in this build
#1130 opened Dec 9, 2024 by r4ghu
6
0.5.2 DML 2x to 4x Slower than 0.4.0 (Big regression) ep:DML performance
#1114 opened Dec 3, 2024 by elephantpanda
1
0.5.2 GPU crashes if initial input is 360 zeros. crash ep:DML
#1113 opened Dec 3, 2024 by elephantpanda
Bug DMLFusedNode_0_0 on second token in 0.5.2 (DML) (Wrong tensor shape) ep:DML
#1112 opened Dec 3, 2024 by elephantpanda
1
.Net After updating to .5, Phi3.5Mini outputs some meaningless characters model quality
#1109 opened Nov 30, 2024 by strikene
onnxruntime-genai generation speed very slow on int4 performance
#1098 opened Nov 23, 2024 by tarekziade
10
awq example runs into error with llama 3.2 3b due to embedding layer documentation and samples Improvements or additions to documentation ep:DML
#1089 opened Nov 22, 2024 by tranlm
2
ProTip! Follow long discussions with comments:>50.