airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andre (JIRA)" <>
Subject [jira] [Work started] (AIRFLOW-173) Create a FileSensor / NFSFileSensor sensor
Date Wed, 25 May 2016 22:46:12 GMT


Work on AIRFLOW-173 started by Andre.
> Create a FileSensor / NFSFileSensor sensor
> ------------------------------------------
>                 Key: AIRFLOW-173
>                 URL:
>             Project: Apache Airflow
>          Issue Type: Improvement
>            Reporter: Andre
>            Assignee: Andre
>            Priority: Minor
> While HDFS and WebHDFS suit most organisations using Hadoop, for some shops running MapR-FS,
Airflow implementation is simplified by the use of plain files pointing to MapR's NFS gateways.
> A FileSensor and/or a NFSFileSensor would assist the adoption of Airflow within the MapR
customer base, but more importantly, help those who are using POSIX compliant distributed
filesystems that can be mounted on Unix derivative systems (e.g. as MapR-FS (via NFS), CephFS,
GlusterFS, etc).

This message was sent by Atlassian JIRA

View raw message