Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enhancements for Trusty Tests #1172

Merged
merged 1 commit into from
Jan 31, 2024
Merged

Enhancements for Trusty Tests #1172

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions ...ving/424_model_serving_bias_metrics.robot → ...ing/424__model_serving_bias_metrics.robot
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -55,6 +55,7 @@ Verify DIR Bias Metrics Available In CLI For Models Deployed Prior To Enabling T
${modelId} Replace String ${modelId} " ${EMPTY}
Schedule Bias Metrics request via CLI metricsType=dir modelId=${modelId} token=${token} protectedAttribute="customer_data_input-3"
... favorableOutcome=0 outcomeName="predict" privilegedAttribute=1.0 unprivilegedAttribute=0.0
Sleep 60s msg=Wait for Trusty Metrics to be calculated and prometheus scraping to be done
Verify TrustyAI Metrics Exists In Observe Metrics trustyai_dir retry_attempts=2 username=${OCP_ADMIN_USER.USERNAME}
... password=${OCP_ADMIN_USER.PASSWORD} auth_type=${OCP_ADMIN_USER.AUTH_TYPE}

Expand Down Expand Up @@ -116,6 +117,7 @@ Install And Verify TrustyAI Service
[Documentation] Install TrustyAI service CRD and verify that TrustyAI resources have spun up
[Arguments] ${namespace}=${PRJ_TITLE}
${return_code} ${output} = Run And Return Rc And Output oc apply -f ${TRUSTYAI_CR_FILEPATH} -n ${namespace}
Sleep 60s msg=Wait for Trusty Route to be created
${return_code} ${output} Run And Return Rc And Output oc get route trustyai-service -n ${namespace} --template={{.spec.host}}
Should Be Equal As Integers ${return_code} 0
Set Suite Variable ${TRUSTY_ROUTE} https://${output}
Expand Down
Loading