Skip to content

Commit

Permalink
enhancement: add monitoring test to check rhoai dashboard metrics by …
Browse files Browse the repository at this point in the history 
…code
  • Loading branch information
@CFSNM
CFSNM committed Jan 13, 2025
1 parent 58b325d commit 9974835
Showing 1 changed file with 42 additions and 1 deletion.
43 changes: 42 additions & 1 deletion ods_ci/tests/Tests/0100__platform/0102__monitor_and_manage/0101__metrics/0101__metrics.robot
View file
Original file line number Diff line number Diff line change
Expand Up @@ -93,7 +93,6 @@ Test Metric Existence For "Rhods_Aggregate_Availability" On ODS Prometheus
@{list_values} = Create List 1 0
Should Contain ${list_values} ${resp.json()["data"]["result"][0]["value"][-1]}


Test Targets Are Available And Up In RHOAI Prometheus
[Documentation] Verifies the expected targets in Prometheus are available and up running
[Tags] Sanity
Expand Down Expand Up @@ -123,6 +122,48 @@ Test Targets Are Available And Up In RHOAI Prometheus
List Should Contain Value ${targets} user_facing_endpoints_status_rhods_dashboard
List Should Contain Value ${targets} user_facing_endpoints_status_workbenches

Test RHOAI Dashboard Metrics By Code Are Defined

Check warning

Code scanning / Robocop

Test case '{{ test_name }}' is too long ({{ test_length }}/{{ allowed_length }}) Warning test

Test case 'Test RHOAI Dashboard Metrics By Code Are Defined' is too long (25/20)

Check warning

Code scanning / Robocop

Test case '{{ test_name }}' has too many keywords inside ({{ keyword_count }}/{{ max_allowed_count }}) Warning test

Test case 'Test RHOAI Dashboard Metrics By Code Are Defined' has too many keywords inside (19/10)
[Documentation] Verifies the RHOAI Dashboard Metrics By Code Are Defined and show accurate values
... (2xx and 5xx codes)
[Tags] Sanity
... Tier1
... ODS-195
... RHOAIENG-13261
... Monitoring
Skip If RHODS Is Self-Managed
${response_by_code}= Prometheus.Run Query

Check warning

Code scanning / Robocop

The assignment sign is not consistent within the file. Expected '{{ expected_sign }}' but got '{{ actual_sign }}' instead Warning test

The assignment sign is not consistent within the file. Expected ' =' but got '=' instead
... pm_url=${RHODS_PROMETHEUS_URL}
... pm_token=${RHODS_PROMETHEUS_TOKEN}
... pm_query=sum(haproxy_backend_http_responses_total {route='rhods-dashboard'}) by(code)
${response_5xx}= Prometheus.Run Query

Check warning

Code scanning / Robocop

The assignment sign is not consistent within the file. Expected '{{ expected_sign }}' but got '{{ actual_sign }}' instead Warning test

The assignment sign is not consistent within the file. Expected ' =' but got '=' instead
... pm_url=${RHODS_PROMETHEUS_URL}
... pm_token=${RHODS_PROMETHEUS_TOKEN}
... pm_query=sum(haproxy_backend_http_responses_total{route='rhods-dashboard', code='5xx'})
${response_2xx}= Prometheus.Run Query

Check warning

Code scanning / Robocop

The assignment sign is not consistent within the file. Expected '{{ expected_sign }}' but got '{{ actual_sign }}' instead Warning test

The assignment sign is not consistent within the file. Expected ' =' but got '=' instead
... pm_url=${RHODS_PROMETHEUS_URL}
... pm_token=${RHODS_PROMETHEUS_TOKEN}
... pm_query=sum(haproxy_backend_http_responses_total{route='rhods-dashboard', code='2xx'})
${response_total}= Prometheus.Run Query

Check warning

Code scanning / Robocop

The assignment sign is not consistent within the file. Expected '{{ expected_sign }}' but got '{{ actual_sign }}' instead Warning test

The assignment sign is not consistent within the file. Expected ' =' but got '=' instead
... pm_url=${RHODS_PROMETHEUS_URL}
... pm_token=${RHODS_PROMETHEUS_TOKEN}
... pm_query=sum(haproxy_backend_http_responses_total{route='rhods-dashboard'}

@{metrics_by_code}= Set Variable ${response_by_code.json()["data"]["result"]}

Check warning

Code scanning / Robocop

The assignment sign is not consistent within the file. Expected '{{ expected_sign }}' but got '{{ actual_sign }}' instead Warning test

The assignment sign is not consistent within the file. Expected ' =' but got '=' instead
${metrics_by_code_5xx}= Set Variable ${metrics_by_code[4]["value"][-1]}

Check warning

Code scanning / Robocop

The assignment sign is not consistent within the file. Expected '{{ expected_sign }}' but got '{{ actual_sign }}' instead Warning test

The assignment sign is not consistent within the file. Expected ' =' but got '=' instead
${metrics_by_code_5xx}= Convert To Number ${metrics_by_code_5xx} 2

Check warning

Code scanning / Robocop

The assignment sign is not consistent within the file. Expected '{{ expected_sign }}' but got '{{ actual_sign }}' instead Warning test

The assignment sign is not consistent within the file. Expected ' =' but got '=' instead
${metrics_by_code_2xx}= Set Variable ${metrics_by_code[1]["value"][-1]}

Check warning

Code scanning / Robocop

The assignment sign is not consistent within the file. Expected '{{ expected_sign }}' but got '{{ actual_sign }}' instead Warning test

The assignment sign is not consistent within the file. Expected ' =' but got '=' instead
${metrics_by_code_2xx}= Convert To Number ${metrics_by_code_2xx} 2

Check warning

Code scanning / Robocop

The assignment sign is not consistent within the file. Expected '{{ expected_sign }}' but got '{{ actual_sign }}' instead Warning test

The assignment sign is not consistent within the file. Expected ' =' but got '=' instead
${metrics_5xx}= Set Variable ${response_5xx.json()["data"]["result"][0]["value"][-1]}

Check warning

Code scanning / Robocop

The assignment sign is not consistent within the file. Expected '{{ expected_sign }}' but got '{{ actual_sign }}' instead Warning test

The assignment sign is not consistent within the file. Expected ' =' but got '=' instead
${metrics_5xx}= Convert To Number ${metrics_5xx} 2

Check warning

Code scanning / Robocop

The assignment sign is not consistent within the file. Expected '{{ expected_sign }}' but got '{{ actual_sign }}' instead Warning test

The assignment sign is not consistent within the file. Expected ' =' but got '=' instead
${metrics_2xx}= Set Variable ${response_2xx.json()["data"]["result"][0]["value"][-1]}

Check warning

Code scanning / Robocop

The assignment sign is not consistent within the file. Expected '{{ expected_sign }}' but got '{{ actual_sign }}' instead Warning test

The assignment sign is not consistent within the file. Expected ' =' but got '=' instead
${metrics_2xx}= Convert To Number ${metrics_2xx} 2

Check warning

Code scanning / Robocop

The assignment sign is not consistent within the file. Expected '{{ expected_sign }}' but got '{{ actual_sign }}' instead Warning test

The assignment sign is not consistent within the file. Expected ' =' but got '=' instead
${metrics_total}= Set Variable ${response_total.json()["data"]["result"][0]["value"][-1]}

Check warning

Code scanning / Robocop

The assignment sign is not consistent within the file. Expected '{{ expected_sign }}' but got '{{ actual_sign }}' instead Warning test

The assignment sign is not consistent within the file. Expected ' =' but got '=' instead
${metrics_total}= Convert To Number ${metrics_total} 2

Check warning

Code scanning / Robocop

The assignment sign is not consistent within the file. Expected '{{ expected_sign }}' but got '{{ actual_sign }}' instead Warning test

The assignment sign is not consistent within the file. Expected ' =' but got '=' instead

Should Match ${metrics_by_code_5xx} ${metrics_5xx}
Should Match ${metrics_by_code_2xx} ${metrics_2xx}
Should Match ${metrics_total} ${metrics_by_code_5xx}+${metrics_by_code_2xx}


*** Keywords ***
Begin Metrics Web Test
Expand Down

0 comments on commit 9974835

Please sign in to comment.