Scaling Fleet and Kubernetes to a Million Clusters

By Rancher Labs - 2020-11-11

Description

We created the Fleet Project to provide centralized GitOps-style management of a large number of Kubernetes clusters. A key design goal of Fleet is to be able to manage 1 million geographically distri ...

Summary

  • We created the Fleet Project to provide centralized GitOps-style management of a large number of Kubernetes clusters.
  • When we architected Fleet, we wanted to use a standard Kubernetes controller architecture.
  • If there is a very high change rate and listing takes long enough, you can easily get into a situation where you finish the list but can’t start a watch because the revision is not available in the API server watch cache or has been compacted in etcd.
  • In general, Kine is much less aggressive in how often it compacts.

 

Topics

  1. Backend (0.16)
  2. Frontend (0.08)
  3. Management (0.08)

Similar Articles

A Custom

By Kubernetes - 2020-12-21

Author: Chris Seto (Cockroach Labs) As long as you're willing to follow the rules, deploying on Kubernetes and air travel can be quite pleasant. More often than not, things will "just work". However, ...

By Cloud Native Computing Foundation - 2020-12-17

Google’s donation will help further the technical maturity and stability of the Kubernetes project SAN FRANCISCO, Calif. – December 17, 2020 – The Cloud Native…