Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement Prometheus metrics for LocalQueue (#3673) #55

Open
wants to merge 57 commits into
base: dev
Choose a base branch
from

Conversation

KPostOffice
Copy link

cherry pick of local-queue metrics features

alculquicondor and others added 30 commits July 19, 2024 07:42
Change-Id: I1890352274a2cdb60b7e19b86386352ed0145983
Co-authored-by: Mykhailo Bobrovskyi <mikhail.bobrovsky@gmail.com>
Co-authored-by: Mykhailo Bobrovskyi <mikhail.bobrovsky@gmail.com>
…etes-sigs#2692)

Signed-off-by: Yuki Iwai <yuki.iwai.tz@gmail.com>
Co-authored-by: Yuki Iwai <yuki.iwai.tz@gmail.com>
Co-authored-by: Traian Schiau <traian_schiau@epam.com>
…#2707)

* Add update-security-insights directive

* Use GIT_TAG instead of RELEASE_VERSION

---------

Co-authored-by: Irving Mondragón <irving_mondragon@epam.com>
Co-authored-by: Mykhailo Bobrovskyi <mikhail.bobrovsky@gmail.com>
…tes-sigs#2740)

Co-authored-by: Mykhailo Bobrovskyi <mikhail.bobrovsky@gmail.com>
Signed-off-by: Yuki Iwai <yuki.iwai.tz@gmail.com>
Co-authored-by: Yuki Iwai <yuki.iwai.tz@gmail.com>
* Cleanup to use FlavorResourceQuantities.Add in cache (kubernetes-sigs#2696)

* fix: Refactor FitInCohort tests (kubernetes-sigs#2655)

* fix: Refactor FitInCohorot tests

* fix: delete no-op function

* fix: use new method to add usage

* fix: to enforce resource group constraint for flavors and resources

* fix: consolidated into a single resource group

* fix: delete flavorNames

* fix: adjusted test cases to align with existing expected conditions

* fix: change FlavorResourceQuantitiesFlat value

* Finish flattening of FlavorResourceQuantities (kubernetes-sigs#2721)

* Finish Flattenning FlavorResourceQuantities

* Rename FlavorResourceQuantitiesFlat to FlavorResourceQuantities

* Cleanup preemption.go (kubernetes-sigs#2800)

* [Partial Admission] Check Mode before attempting Preemption (kubernetes-sigs#2809)

* Prefer Reclamation to Priority Based Preemption (kubernetes-sigs#2811)

---------

Co-authored-by: s-shiraki <54130718+highpon@users.noreply.github.com>
* Move declaration of the Preempted reasons to API pkg

* Fix when PrioritySortingWithingCohort is disabled
…staging registry (kubernetes-sigs#2832)

* Publish images to new staging registry

* Update image registry name

---------

Co-authored-by: Irving Mondragón <irving_mondragon@epam.com>
Co-authored-by: Irving Mondragón <irving_mondragon@epam.com>
…ter deleting resource from (kubernetes-sigs#2879)

* Fixed overadmission after deleting resource from borrowing CQ.

* Removed filterLocalQueueUsage.

* Removed empty FlavorResourceQuantities objects on tests.
…hot clusterQueue. (kubernetes-sigs#2918)

* Deep clone ResourceGroups instead shallow copy on snapshot clusterQueue.

* Initialize ResourceGroups to the size of the original.

---------

Co-authored-by: Mykhailo Bobrovskyi <mikhail.bobrovsky@gmail.com>
Change-Id: I482b40fa841bcfa5b409425f3015b27723940b85
…ebhook on new CRDs availability (kubernetes-sigs#2991)

* Start Controller and Webhook on new CRDs availability

* Log errors from JobFramework controller and webhook

* Add test case for delayed JobFramework API becoming available

* Wait for API integration to be enabled

* Implement synchronization for safe concurrent access

* Implement exponential backoff for waitForAPI() and add function type to streamline REST mapping checks

* Add Job Framework API to mapper directly

* Cast mgr.GetRESTMapper() to *TestRESTMapper and ensure proper locking for tests
Copy link

openshift-ci bot commented Dec 10, 2024

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: KPostOffice

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

* add LocalQueue metrics (no feature gate)

Signed-off-by: Kevin <kpostlet@redhat.com>

* add all clear and report calls

Signed-off-by: Kevin <kpostlet@redhat.com>

* add feature gate

Signed-off-by: Kevin <kpostlet@redhat.com>

* cleanup todos and add more feature gates

Signed-off-by: Kevin <kpostlet@redhat.com>

* use feature gate instead of config

Signed-off-by: Kevin <kpostlet@redhat.com>

* cleanup

Signed-off-by: Kevin <kpostlet@redhat.com>

* add metrics checks to a test

Signed-off-by: Kevin <kpostlet@redhat.com>

* add lq metrics to cq integration test

Signed-off-by: Kevin <kpostlet@redhat.com>

* lint fix

Signed-off-by: Kevin <kpostlet@redhat.com>

* use name instead of local_queue

Signed-off-by: Kevin <kpostlet@redhat.com>

* update status metric description

Signed-off-by: Kevin <kpostlet@redhat.com>

* fix key name

Signed-off-by: Kevin <kpostlet@redhat.com>

* move registerLQ into metrics package

Signed-off-by: Kevin <kpostlet@redhat.com>

---------

Signed-off-by: Kevin <kpostlet@redhat.com>
@KPostOffice
Copy link
Author

/retest

Signed-off-by: Kevin <kpostlet@redhat.com>
@KPostOffice
Copy link
Author

/retest

@KPostOffice
Copy link
Author

I was debugging this test and noticed that the image being used when I ran the test was registry.k8s.io/kueue/kueue:v0.8.1 this version doesn't have the feature flag... but that confuses me. Shouldn't we be creating a new image based on the PR to run against when we run these tests so that the new changes are correctly tested?

@ChristianZaccaria ChristianZaccaria force-pushed the dev branch 3 times, most recently from 367ed20 to ce05603 Compare January 15, 2025 17:18
Copy link

openshift-ci bot commented Jan 15, 2025

@KPostOffice: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/e2e-odh-kueue b859cc2 link true /test e2e-odh-kueue
ci/prow/images b859cc2 link true /test images

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.