Skip to content

Releases: microsoft/onnxruntime-genai

v0.3.0

21 Jun 21:23
@baijumeswani baijumeswani
v0.3.0
964eb65
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.3.0 Latest
Latest

Release Notes

  • Phi-3 Vision model support for DML EP.
  • Addressed DML memory leak issue and crashes on long prompts.
  • Addressed crashes and slowness on CPU EP GQA on long prompts due to integer overflow issues.
  • Added the import lib for windows C API package.
  • Addressed a bug with get_output('logits') so that it returns the logits for the entire prompt and not for the last generated token.
  • Addressed a bug with querying the device type of the model so that it won't crash.
  • Added NetStandard 2.0 compatibility.
Assets 9
Loading

ONNX Runtime GenAI v0.3.0-rc2

30 May 17:24
@baijumeswani baijumeswani
v0.3.0-rc2
d536387
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
ONNX Runtime GenAI v0.3.0-rc2 Pre-release
Pre-release

Release Notes

  • Added support for the Phi-3-Vision model.
  • Added support for the Phi-3-Small model.
  • Removed usage of std::filesystem to avoid runtime issues when loading incompatible symbols from stdc++ and stdc++fs.
Assets 7
Loading