Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
-
Updated
Aug 19, 2024 - Python
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code
Free MLOps course from DataTalks.Club
A curated list of awesome projects and resources related to Argo (a CNCF graduated project)
Polaris: High performance workflow orchestrator for Golang
A curated list of awesome projects and resources related to Kubeflow (a CNCF incubating project)
Open source AI platform for rapid development of advanced AI and AGI pipelines.
SpiffWorkflow is a software development platform for building, running, and monitoring executable diagrams
Data Engineering examples covering Airflow and Mage for workflows; dbt for BigQuery, Redshift, ClickHouse; Spark and Kafka for Batch/Streaming Processing
The Kubernetes native and CloudEvents native distributed event streaming, event orchestration & messaging platform
An end to end ML project. Using MLflow for experiment tracking and model registry. Prefect for workflow orchestration. S3 for artifacts storage. AWS Lambda/ ECR for serverless model serving. AWS REST API gateway as endpoint to lambda function. GitHub Actions for CI/CD.
m2m is a node.js library for developing machine-to-machine and edge applications using the node-m2m framework.
A microservices flow orchestrator and workflow manager.
Repo for my MLOps Zoomcamp project
Bring Infrastructure as Code best practices to your data workflows with Kestra and Terraform
examples of Event-Driven Architectures (EDA) and Domain Driven Design (DDD) patterns implemented using eventual
Notes, homeworks, and projects for MLOps Zoomcamp @ datatalks.club
Our startup, Mela, aims to simplify cryptocurrency trading for everyone and provide reliable investment sources while mitigating risks. We aim to design and build a reliable, large-scale trading data pipeline that can run various backtests and store useful artifacts in a robust data warehouse.
Add a description, image, and links to the workflow-orchestration topic page so that developers can more easily learn about it.
To associate your repository with the workflow-orchestration topic, visit your repo's landing page and select "manage topics."