hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jonathan Coveney <jcove...@gmail.com>
Subject A way to monitor HDFS for a file to come live, and then kick off a job?
Date Thu, 24 Mar 2011 17:09:45 GMT
I am not sure if this is the right listserv, forgive me if it is not. My
goal is this: monitor HDFS until a file is create, and then kick off a job.
Ideally I'd want to do this continuously, but the file would be create
hourly (with some sort of variance). I guess I could make a script that
would ping the server every 5 minutes or something, but I was wondering if
there might be a more elegant way?


View raw message