Message view | « Date » · « Thread » |
---|---|
Top | « Date » · « Thread » |
From | K Zharas <kgzha...@gmail.com> |
Subject | HdfsSpout |
Date | Mon, 08 Feb 2016 12:53:01 GMT |
Hi. 1) How can I set "HdfsSpout" so that it will emit a tuple every X seconds? Is it done by "hdfsspout.commit.sec = 30"? 2) I have only one file which has 300+ lines. After processing all the line it does not move it to "done" directory, and it still has ".lock" & ".inprogress". Also, it gives an error like "couldn't find the next file". What I want to do is to move the file into "done" directory, once "HdfsSpout" emits all the lines and to kill topology (stop program). Thank you. | |
Mime |
|
View raw message |