Kestra 2.0: A New Engine, Workers Anywhere, and Flows as Agent Tools | Kestra
Kestra 2.0 splits into a control plane and data plane, letting workers connect via gRPC instead of requiring direct database access, which means you can deploy them across regions and networks. The release also adds AI agent integration, a revamped no-code editor, and decouples the queue from the database for simpler configuration.
- Workers now connect to the control plane over a single outbound gRPC stream instead of needing direct database access, enabling deployment in different regions, clouds, or restricted networks without opening inbound ports.
- Queue and repository are now independent, so you pick them separately (Postgres, Kafka, Redis, or AMQP) instead of being locked into paired options; this simplified the codebase to one implementation instead of multiple backends.
- MCP Tool Trigger exposes any existing flow as a callable tool for AI agents like Claude, skipping the need for custom integration layers.
- AI Copilot is now a persistent sidebar with three modes (Edit, Plan, Ask) that refines flows iteratively rather than generating from scratch, and reads your namespace configuration to ground suggestions.
Kestra 2.0 Summary
Kestra 2.0 overhauls the platform's core architecture by splitting it into a control plane and data plane. Workers no longer need direct database access—they connect to the control plane through a single outbound gRPC stream, which means they can run in different regions, clouds, or networks that only allow outbound connections. This is a big deal for security and deployment flexibility. The queue and database are now decoupled too. Previously, you had to choose between Postgres/MySQL or Kafka/Elasticsearch for both, and every feature needed separate implementations for each. Now they're independent, so there's one codebase underneath regardless of whether you use Postgres, Kafka, Redis, or AMQP for the queue. The gRPC connection can be encrypted with TLS or mTLS, and workers present certificates or JWTs before receiving jobs—no inbound ports required.
The feature set expands significantly across the three editions (OSS, Enterprise, Cloud). AI integration gets real teeth: flows can be exposed as tools that AI agents call directly through the MCP Tool Trigger, and the AI Copilot now runs as a persistent sidebar with three modes—Edit for generating YAML, Plan for step-by-step task execution, and Ask for questions. The no-code editor syncs with YAML and the Copilot. Enterprise users get incident management through Cases, environment promotion with drift detection, namespace-scoped governance policies, and action-based RBAC instead of CRUD permissions. Worker Groups 2.0 adds tag-based routing and capacity reservation. New task runners support AWS EC2, Azure VMs, Google Compute Engine, and Huawei CCI.
Upgrading from 1.x requires being on 1.3.x first. Several constructs disappear—ForEach, trigger conditions, workerGroup.key, and pluginDefaults—but the kestra-migrate tool handles most rewrites automatically. Breaking changes get dedicated migration guides. For fresh deployments, Kestra recommends starting with a single Postgres instance handling both queue and repository, then moving the queue to Kafka or Redis later if you need lower latency or higher throughput. The architecture docs and backend configuration guide cover which combinations work best for different scenarios.