-
-
Notifications
You must be signed in to change notification settings - Fork 5
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Update Habana UBI image to fix CVE, GRPC issue and WARMUP issue #12
Update Habana UBI image to fix CVE, GRPC issue and WARMUP issue #12
Conversation
pip install $(echo dist/*.whl)'[tensorizer]' jinja2>=3.1.5 --verbose | ||
|
||
ENV HF_HUB_OFFLINE=1 \ | ||
PORT=8000 \ | ||
HOME=/home/vllm \ | ||
VLLM_USAGE_SOURCE=production-docker-image | ||
VLLM_USAGE_SOURCE=production-docker-image \ | ||
VLLM_NO_USAGE_STATS=1 \ | ||
VLLM_SKIP_WARMUP=true \ | ||
PT_HPU_MAX_COMPOUND_OP_SIZE=10 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
These changes seem unrelated (CVE fix + other). Can you split it up in separate commits and update the PR title accordingly?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
done... create three seperate commit
[APPROVALNOTIFIER] This PR is NOT APPROVED This pull-request has been approved by: dtrifiro, vaibhavjainwiz The full list of commands accepted by this bot can be found here.
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
Signed-off-by: Vaibhav Jain <vajain@redhat.com>
430f937
to
13e45dc
Compare
Signed-off-by: Vaibhav Jain <vajain@redhat.com>
Signed-off-by: Vaibhav Jain <vajain@redhat.com>
No description provided.