hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: Folder as Input and update the folder while the task is running
Date Thu, 28 Jun 2012 05:50:41 GMT
The job starts up with a static list of paths and splits derived from
it during submission time. Input files added to the directory after
the job has been submitted are not considered.

On Wed, Jun 27, 2012 at 11:15 PM, Félix López <jaaaelpumuki@gmail.com> wrote:
> I have a task with a folder as input: FileInputFormat.setInputPaths(job, new
> Path("/folder"));
> What happens when the task is running and I write new files in the folder?
> The task receive the new files or not?
> Thanks

Harsh J

View raw message