flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From phi...@free.fr
Subject Flink and Directory Monitors
Date Mon, 07 Mar 2016 14:53:01 GMT
Hello,

has anyone ever used Flink with file/directory monitoring applications such as Directory Monitor
(https://directorymonitor.com/)?

Is it conceivable to process file-update events with Flink? For instance, let's says hundreds
of users simultaneously modify files on a filesystem. Directory Monitor detects those modifications
and send them as events/streams/or logs entries to Flink, which processes them to extract,
say, the names of the files that have been modified the most, over a period of time, or the
names of the biggest filesystem hogs (i.e., users who consume the most filesystem space).

Would Hadoop be needed between Directory Monitor and Flink, to store historical, filesystem-change
data?

Many thanks.

Philippe


Mime
View raw message