Suppose you're a batch manager A. How do you know whether any task managers are online and where should the doTask request be sent?
- Locally, for testing purposes, we can assume static configuration
- GKE
- clusters/services (groups of masters, managers, workers etc.)
- we can use health check service - no need to create hierarchical gRPC HC, just network ping handlers https://cloud.google.com/blog/products/containers-kubernetes/kubernetes-best-practices-setting-up-health-checks-with-readiness-and-liveness-probes
- Storage done via Filestore https://cloud.google.com/filestore/docs/filestore-for-gke
-
we define services (
workers,task-managersetc) for each process type to expose them in the internal network https://kubernetes.io/docs/concepts/services-networking/service/discovery would be via i.e.
WORKERS_SERVICE_HOSTandWORKERS_SERVICE_PORTenv vars as shown here: https://kubernetes.io/docs/concepts/services-networking/service/#discovering-services