-
Notifications
You must be signed in to change notification settings - Fork 75
feat: add compilation algorithms #443
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Comment @cursor review or bugbot run to trigger another review on this PR
johannaSommer
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks supergood already, just had two quick comments! 🌻😊
|
This PR has been inactive for 10 days and is now marked as stale. |
af1db40 to
b5a14c1
Compare
|
Unfortunately, it seems that the IPEX backend will be deprecated soon. While there is no specific indication about the IPEX LLM library being deprecated, perhaps there could be a re-consideration to add this backend? WDYT? |
b5a14c1 to
9c1572e
Compare
|
Hi @ParagEkbote, Thanks so much for the feedback! 🙌 IPEX LLM was previously part of Pruna Pro, and we're excited to open-source it alongside many of the algorithms we’re bringing into the Pruna package. Given Intel’s deprecation timeline (EOL March 2026) and their recommendation to use PyTorch directly, we're still evaluating whether this backend makes sense to maintain long-term in the open-source version. For now, we're including it so users can benefit from the functionality today, but we may phase it out in the future as Intel’s features continue to be upstreamed into PyTorch. |
Description
Added x fast and ipex llm to Pruna.
Type of Change
How Has This Been Tested?
It has been tested in as the other algorithms.
Checklist