Simplified Kubernetes Architecture with Diagrams

Suyash DahituleSuyash Dahitule
4 min read

Oooh, here we are — the big elephant in the DevOps room: Kubernetes.
Everyone talks about it, most fear it, and beginners often feel lost staring at diagrams full of boxes, arrows, and acronyms.

💭 “Kubernetes isn’t scary once you understand its building blocks. Think of it as a city — the control plane is the city council, the nodes are neighborhoods, and the pods are the homes where your applications live.”

When I first looked at a Kubernetes architecture diagram, I’ll be honest: it was overwhelming. But once I broke it down into roles and responsibilities, it clicked. And that’s exactly what I’ll do for you today — walk you through Kubernetes architecture step by step, so you can not only understand it but explain it like a pro.


🎯 The Big Picture

At its core, Kubernetes has two main brains:

  1. Control Plane 🧠 (the management/decision-making layer)

  2. Nodes 💪 (the execution layer where workloads actually run)

Think of it like a city:

  • The Control Plane = City Council making policies and decisions.

  • The Nodes = Neighborhoods where people (pods/containers) live and work.

  • The Pods = Actual homes where your applications run.


📊 Kubernetes Architecture Diagram

🧠 Control Plane Components

These are the decision-makers of the cluster:

1️⃣ API Server (kube-apiserver)

📌 The “front door” of Kubernetes.

  • All commands (kubectl apply, dashboards, automation tools) go through this.

  • Validates requests and updates the cluster state.

2️⃣ etcd (Key-Value Store 📚)

📌 The memory of Kubernetes.

  • Stores cluster state, configurations, secrets.

  • Distributed and fault-tolerant (never lose your city’s records).

3️⃣ Scheduler (kube-scheduler)

📌 The planner.

  • Decides which node a pod should run on.

  • Looks at CPU, memory, affinity, and node health before assigning.

4️⃣ Controller Manager (kube-controller-manager)

📌 The enforcer.

  • Ensures desired state = actual state.

  • If a pod dies, it spins up another. If a node goes down, workloads are rescheduled.

5️⃣ Cloud Controller Manager (CCM)

📌 The bridge to your cloud provider.

  • Integrates with AWS, GCP, Azure for load balancers, storage volumes, node lifecycle.

💪 Node Components (Workers)

Each node is a worker neighborhood, and it has its own set of roles:

1️⃣ Kubelet

📌 The foreman of the neighborhood.

  • Talks to the API server.

  • Makes sure the pods assigned to the node are actually running.

2️⃣ Kube-proxy

📌 The traffic cop.

  • Manages network routing inside the cluster.

  • Ensures requests reach the right pod.

3️⃣ Container Runtime

📌 The engine that actually runs containers.

  • Could be Docker, containerd, or CRI-O.

🧩 Workloads and Abstractions

  • Pods – The smallest deployable unit; contains one or more containers.

  • ReplicaSets – Guarantees multiple copies of a pod for reliability.

  • Deployments – Higher-level abstraction that manages ReplicaSets, scaling, and updates.

  • Services – Stable networking endpoints (ClusterIP, NodePort, LoadBalancer).


🔄 How It All Works Together

Imagine you run:

kubectl create cluster --config _name_.yaml
  • The API Server validates the request.

  • The Scheduler picks the best node.

  • etcd records the new desired state.

  • The Kubelet on that node runs the pod.

  • Kube-proxy makes sure traffic reaches your app.

  • The Controller Manager ensures if something fails, it’s recreated.


💡 Lessons From the Architecture

  • Kubernetes is about separation of concerns: management vs execution.

  • It follows a declarative model: you say what you want, it figures out how.

  • Resilience is baked in: controllers and replicas recover automatically.

  • Cloud-native by design: works across any environment.


🚀 Final Thoughts

The first time you see Kubernetes architecture, it feels like a mess of boxes and arrows. But here’s the mindset shift:

Kubernetes is like an orchestra:

  • The Control Plane is the conductor.

  • The Nodes are the musicians.

  • The Pods are the instruments playing your applications.

Once you see it this way, Kubernetes stops being scary and starts becoming… elegant.

So next time someone asks you, “What is Kubernetes architecture?” — don’t just show them a diagram. Tell them a story.

#DevOps #Kubernetes #CloudNative #K8sArchitecture #Containers #LearnInPublic #ThoughtLeadership

0
Subscribe to my newsletter

Read articles from Suyash Dahitule directly inside your inbox. Subscribe to the newsletter, and don't miss out.

Written by

Suyash Dahitule
Suyash Dahitule