kestra
Kestra is an open-source workflow orchestration and automation platform that enables organizations to define, schedule, and monitor both event-driven and time-based workflows. It brings Infrastructure-as-Code principles to orchestration, allowing teams to manage processes through YAML definitions or an intuitive user interface. Kestra is designed for data engineers, developers, and DevOps teams who need to automate data pipelines, integrate distributed systems, or coordinate multi-step workflows across hybrid or cloud environments. Core Capabilities Declarative orchestration: Workflows are defined in YAML and automatically synchronized with changes made through the UI or API. Event-driven and scheduled triggers: Supports automation initiated by timers or external events such as file arrivals, API calls, or message queues (Kafka, Redis, Pulsar, AMQP, MQTT, NATS, AWS SQS, Google Pub/Sub, Azure Event Hubs). Visual workflow design: Build and modify workflows directly in the browser with syntax validation, auto-completion, and real-time DAG visualization. Scalability and resilience: Distributed architecture provides high availability, fault tolerance, retries, and backfill management for millions of executions. Plugin ecosystem: Hundreds of integrations for databases, APIs, cloud platforms, and languages including Python, Node.js, Go, R, and Shell. Key Benefits Unified orchestration layer: Manage scheduled and event-based workflows in one system instead of maintaining separate schedulers or automation tools. Version control integration: Workflows can be stored in Git repositories, supporting CI/CD pipelines and Terraform for Infrastructure-as-Code management. Multi-environment flexibility: Deploy locally, in containers, or across Kubernetes clusters and major cloud providers (AWS, GCP, Azure). Observability and notifications: Track executions, manage inputs and outputs, and send alerts via Slack, PagerDuty, or email. Extensibility: Users can develop custom plugins to extend functionality and standardize internal operations. Typical Use Cases Data orchestration: Build and schedule ETL pipelines, batch or streaming data processes, and big-data workflows with tools like Spark and BigQuery. AI and ML automation: Coordinate model training, evaluation, and deployment workflows. Infrastructure automation: Replace cron jobs or legacy schedulers with declarative, event-driven execution. Microservice coordination: Connect APIs and services into reliable end-to-end processes. Getting Started Kestra can be launched locally in one command using Docker or deployed in production environments with Docker Compose, Kubernetes, or AWS CloudFormation. Users can create and run their first “Hello World” workflow in minutes via the built-in editor or API. Community and Support Kestra is distributed under the Apache 2.0 License and maintained by an active open-source community.
Average Rating: 4.6/5.0
Total Reviews: 24
How Do G2 Users Rate kestra?
- Ease of Admin: 10.0/10 (Category avg: 8.7/10)
- Quality of Support: 9.8/10 (Category avg: 9.0/10)
- Has the product been a good partner in doing business?: 10.0/10 (Category avg: 9.1/10)
- Ease of Use: 9.6/10 (Category avg: 8.8/10)
Who Is the Company Behind kestra?
- Seller: Kestra Technologies
- Year Founded: 2022
- HQ Location: Paris, FR
-
Twitter: @kestra_io
3,146 Twitter followers -
LinkedIn® Page: www.linkedin.com
87 employees on LinkedIn®
Who Uses This Product?
- Top Industries: Computer Software
- Company Size: 83% Small, 8% Medium
What Do G2 Reviewers Say About kestra?
AI-generated summary from verified user reviews
Pros
- Users appreciate the centralized management of Kestra, enhancing collaboration and streamlining workflow across teams effectively.
- Users commend the responsive customer support of Kestra, enhancing their ability to develop and implement workflows effectively.
- Users appreciate the customization options in Kestra, facilitating workflow integration and enhancing team collaboration.
- Users commend Kestra for its exceptional data security and reliability, significantly enhancing their data automation capabilities.
- Users commend the excellent documentation of Kestra, which facilitates easy growth and development for teams.
Cons
- Users find the alert overload in Kestra's UI overwhelming, complicating task management and filtering efforts.
- Users find the Logging/Task Runs menu overwhelming, making it difficult to filter and navigate effectively.
What Are Recent G2 Reviews of kestra?
"Exceptional Orchestration for Resilient, Self-Healing Data Pipelines"
Rating: 4.0/5.0 stars
— Deemanth G.
"The Adamantium to my fragile AI pipeline"
Rating: 4.5/5.0 stars
— Khushal A.

