flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vasiliki Kalavri <vasilikikala...@gmail.com>
Subject Input from nested directory structure
Date Tue, 02 Dec 2014 15:32:57 GMT
Hello all,

I want to run a Flink log processing job and my input is stored locally in
a nested directory structure, like the following:

logs_dir/
|-----/machine1/
|-----------/january.log
|-----------/february.log
...
|-----/machine2/
...

etc.

When providing "logs_dir" as the argument to readTextFile(), nothing is
read and no an exception or error is returned.
Copying the nested individual files machine1/january.log,
machine1/february.log, ..., to the same directory works fine, but I was
wondering whether there is a better way to do this?

Thank you!
V.

Mime
View raw message