Business Intelligence
Now Reading
Apache Airflow
1
Review

Apache Airflow

Overview
Synopsis

Airflow is a platform to programmatically author, schedule and monitor workflows.

Category

ETL Software Free

Features

• Airflow pipelines are configuration as code (Python), allowing for dynamic pipeline generation
• Easily define your own operators, executors and extend the library so that it fits the level of abstraction.
• Airflow pipelines are lean and explicit.
•Parameterizing your scripts is built into the core of Airflow using the powerful Jinja templating engine.
•Airflow has a modular architecture and uses a message queue to orchestrate an arbitrary number of workers.

License

Open Source

Pricing

Subscription

Free Trial

Available

Users Size

Small (<50 employees), Medium (50 to 1000 employees), Enterprise (>1001 employees)

Company

Apache Airflow

What is best?

• Airflow pipelines are configuration as code (Python), allowing for dynamic pipeline generation
• Easily define your own operators, executors and extend the library so that it fits the level of abstraction.
• Airflow pipelines are lean and explicit.

What are the benefits?

• Dynamic
• Extensible
• Elegant
• Scalable

PAT Rating™
Editor Rating
Aggregated User Rating
Rate Here
Ease of use
9.5
6.9
Features & Functionality
9.4
7.0
Advanced Features
9.6
6.8
Integration
9.4
7.0
Performance
9.5
8.3
Customer Support
9.6
6.9
Implementation
7.1
Renew & Recommend
6.8
Bottom Line

Apache Airflow is an open-source tool that works by programmatically authoring, scheduling and monitoring workflows.

9.5
Editor Rating
7.2
Aggregated User Rating
6 ratings
You have rated this

Apache Airflow is an open-source tool for authoring, scheduling and monitoring workflows. In other words, it performs computational workflows that are complex and also data processing pipelines.

Airflow is ideal for your business if you are involved in executing very long scripts are even keeping a calendar of big data processing batch jobs. Apache airflow has an airflow scheduler that executes your tasks on an array of workers while following the specified dependencies. It has a rich command line utility that makes performing complex surgeries on DAGs (Directed Acyclic Graph- a collection of all the tasks you want to run, organized in a way that reflects their relationships and dependencies) very easy.

It also has a rich user interface that makes it easy to visualize pipelines running in production, monitor progress and, and troubleshoot issues when needed.Airflow workflows are expected to look similar from a run to the next, this allows for clarity around unit of work and continuity.Airflow provides a simple query interface to write SQL and get results quickly, and a charting application letting you visualize data.

The Airflow scheduler monitors all tasks and all DAGs, and triggers the task instances whose dependencies have been met. Behind the scenes, it monitors and stays in sync with a folder for all DAG objects it may contain, and periodically (every minute or so) inspects active tasks to see whether they can be triggered.

You may like to read: Top Extract, Transform, and Load, ETL Software, How to Select the Best ETL Software for Your Business and Top Guidelines for a Successful Business Intelligence Strategy

Filter reviews
User Ratings





User Company size



User role





User industry





1 Reviews
  • Madison
    December 24, 2017 at 6:40 pm

    It offers robust functionality through a command line interface (CLI).  

    Company size

    Medium (50 to 1000)

    User Role

    Executive

    User Industry

    Pharmaceutical

    Rating
    Ease of use8.4

    Features & Functionality8

    Easily define your own operators, executors and extend the library so that it fits the level of abstraction that suits your environment. 

    Advanced Features8.4

    Integration8

    Training 8

    Customer Support8

    Implementation8

    ADDITIONAL INFORMATION
    Apache Airflow is a WMS that defines tasks and their dependencies as code, executes those tasks on a regular schedule, and distributes task execution across worker processes. Airflow offers an excellent UI that displays the states of currently active and past tasks, shows diagnostic information about task execution.

Ease of use
Features & Functionality
Advanced Features
Integration
Performance
Customer Support
Implementation
Renew & Recommend

What's your reaction?
Love It
0%
Very Good
0%
INTERESTED
0%
COOL
0%
NOT BAD
0%
WHAT !
0%
HATE IT
0%