KAIF·k8s agentic ai fabric
Layer 3 · Detailed Architecture

The full component map

Ten planes, top to bottom. The top three are where humans and agents interact. The middle four are how agents are built and run. The bottom three are the foundations every cluster needs.

Stack diagram

Ten planes, one cluster

Experience Plane
humans

Where humans and other systems meet the agents.

Experience Plane

humans
Backstage portalChat / IDE clientsOperator dashboardsAPI consumers
Harness Plane
control

Cross-cutting control plane shared by all three lifecycles.

Harness Plane

control
Agent RegistryPrompt / Tool CatalogMemory ServicePolicy Engine (OPA)Eval GatewayFeedback Service
Agent Runtime Plane
agents

The agents themselves and the sandboxes they run in.

Agent Runtime Plane

agents
Agent CRDsLangGraph / CrewAI podsTool sidecarsgVisor / Kata sandboxesKEDA autoscalingKnative services
Model Plane
inference

Model serving and the accelerators behind it.

Model Plane

inference
KServe + vLLMEmbedding servicesGPU pools (NVIDIA GPU Operator)Karpenter autoscalerModel registry (Harbor / KitOps)
Data Plane
state

Persistent state for agents: memory, retrieval, eval data.

Data Plane

state
Vector DB (Weaviate / Qdrant)CloudNativePG (Postgres)MinIO (object store)Eval & feedback datasetsFeature store
Orchestration Plane
workflows

Workflows, jobs and events that move agents through their work.

Orchestration Plane

workflows
Argo WorkflowsArgo EventsKueue (batch)Tekton (CI)
Delivery Plane
gitops

How code becomes running pods, safely.

Delivery Plane

gitops
Argo CD / FluxArgo RolloutsHarbor (OCI registry)Kyverno (policy)Sigstore / cosign
Observability Plane
telemetry

Traces, metrics, logs and LLM-specific signals.

Observability Plane

telemetry
OpenTelemetry CollectorPrometheusTempoLokiGrafanaLangfuse / Phoenix
Security Plane
trust

Identity, secrets, policy and content safety.

Security Plane

trust
SPIFFE / SPIREOPAExternal Secrets + VaultNetworkPoliciesNeMo GuardrailsLlama Guard
Platform Plane (Kubernetes)
substrate

The Kubernetes substrate everything else stands on.

Platform Plane (Kubernetes)

substrate
Nodes (CPU / GPU)CNI (Cilium)CSI storageIngress / Gateway APICluster autoscaler
How to read it

Where the three pillars live

Each pillar from Layer 2 spans multiple planes — the Harness is the glue.

Development
  • Experience
  • Harness
  • Delivery (CI half)
  • Data (datasets)
Deployment
  • Delivery (CD half)
  • Agent Runtime
  • Model
  • Security
  • Platform
Evaluation
  • Observability
  • Harness (Eval Gateway)
  • Data
  • Orchestration