Run Airflow in AWS ECS(Elastic Container Service) using Fargate tasks

Any Airflow project day 1, you can spin up a local desktop Kubernetes Airflow environment AND one in Google Cloud Composer with tested data pipelines(DAGs) 🖥️ >> [ 🚀, 🚢 ]

Terraform module to deploy an Apache Airflow cluster on AWS, backed by RDS PostgreSQL for metadata, S3 for logs and SQS as message broker with CeleryExecutor

Terraform module for Amazon MWAA(Apache Airflow)

An example of how to deploy Apache Airflow on Amazon ECS Fargate

Production Grade Terraform for Provisioning Infrastructure

Terraform module for a PostgreSQL-backed Apache Airflow instance

AWS MWAA Quick Start With Terraform.

A batch Data Pipeline that retrieves data from a user purchase table and a movie review table and is transformed to form a user behaviour metric table.

A Terraform template for provisioning Apache Airflow workflows on AWS ECS Fargate

AWS MWAA Quick Start With Terraform (Private Web Server).

Use Airflow to pull in remote data via API, pub/sub, kinesis, s3 etc. and then store it in s3 for later consumption by other services.

Easily deploy airflow infrastructure on an AWS VPC using terraform.

Tools for DevOps and MLOps. Materials and projects. New technologies and infrastructure review.

Fully equipped AirFlow service on aws, as simple to run as possible.

AWS Summit 2022 ASEAN --- COM203 Using IaC with Terraform to provision Big Data Platform on Amazon EMR

...an automated data pipeline that retrieves cryptocurrency data from the CoinCap API, processes and transforms it for analysis, and presents key metrics on a near-real-time dashboard

Mini Data Platform

Best in class Open Source tools, in production, with the press of a button.

Terraform frame to deploy a MLOps plattform on AWS EKS using Airflow, MLflow, and Jupyterhub.