Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add ARM64 support. #637

Closed
azchohfi opened this issue Jun 24, 2024 · 2 comments
Closed

Add ARM64 support. #637

azchohfi opened this issue Jun 24, 2024 · 2 comments
Labels
enhancement New feature or request ep:DML

Comments

@azchohfi
Copy link
Contributor

Still can't leverage the DirectML version of this package (Microsoft.ML.OnnxRuntimeGenAI.DirectML) on ARM64 machines (Copilot+ PCs):
https://nuget.info/packages/Microsoft.ML.OnnxRuntimeGenAI.DirectML/0.3.0
@azchohfi azchohfi mentioned this issue Jun 24, 2024
Merged
@nmetulev nmetulev mentioned this issue Jul 10, 2024
Open
@baijumeswani baijumeswani added the enhancement New feature or request label Jul 10, 2024
@skyline75489 skyline75489 mentioned this issue Jul 11, 2024
Merged
@liuyunms
Copy link

Support for ARM64 machines is coming soon. Please stay tuned for future updates.

@leestott leestott mentioned this issue Jul 12, 2024
Closed
@IntranetFactory
Copy link

IntranetFactory commented Jul 19, 2024 •
edited
Loading

@liuyunms it seems that my definitions of "soon" and "completed" differs from yours. Do you have any ETA ?

skyline75489 added a commit that referenced this issue Jul 24, 2024
@skyline75489 @baijumeswani @kunal-vaishnavi
Improve Windows ARM64 building & packaging (#687)
1f96323 
A major overhaul of the NuGet packaging pipeline, including:

* Restructure capi & NuGet packaging pipeline to make multi-platform
nupkg possible. The NuGet artifacts are separated by EP(CPU, Cuda and
DirectML). A single nupkg contains native libraries for different os &
arch.
* Make win-arm64 CPU packages use DLLs from NuGet package, just like
win-x64.
* Enable win-arm64 DirectML NuGet build & packaging (Internal work item:
https://task.ms/aii/40037)
* Enable linux-x64 CPU & CUDA NuGet build & packaging (Internal work
item: https://task.ms/aii/34234)
* Continue the work of #683 to make it work with ARM64.

Run:
https://dev.azure.com/aiinfra/ONNX%20Runtime/_build/results?buildId=507547&view=results

Prior work: #498 
Supports: #637

 Future work: Needs #693 to fix Linux NuGet.

---------

Co-authored-by: Baiju Meswani <bmeswani@microsoft.com>
Co-authored-by: kunal-vaishnavi <115581922+kunal-vaishnavi@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request ep:DML
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@azchohfi @IntranetFactory @baijumeswani @liuyunms