storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From K Zharas <>
Subject HdfsSpout
Date Mon, 08 Feb 2016 12:53:01 GMT

1) How can I set "HdfsSpout" so that it will emit a tuple every X seconds?
          Is it done by "hdfsspout.commit.sec = 30"?
2) I have only one file which has 300+ lines. After processing all the line
it does not move it to "done" directory, and it still has ".lock" &
".inprogress". Also, it gives an error like "couldn't find the next file".
          What I want to do is to move the file into "done" directory, once
"HdfsSpout" emits all the lines and to kill topology (stop program).

Thank you.

View raw message