feat: Intel Hardware Support #139
tikikun
started this conversation in
Feature Requests
Replies: 1 comment
-
regarding issue that leads to this discussion: |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Currently nitro can be compiled with intel MKL, however there are ongoing efforts from intel for LLMs inferencing that offers better performance.
Criteria that we might want:
That said with above options and multiple documents regarding on how to do things on intel hardware i think it will be awesome if we can have discussion and more insights on this matter.
Beta Was this translation helpful? Give feedback.
All reactions