nifi-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sivaprasanna <sivaprasanna...@gmail.com>
Subject Proposal: Specifying range for List and Get processors
Date Tue, 27 Mar 2018 06:35:50 GMT
I have been thinking about this lately. Now that NiFi has a wider presence
on the big data stack, I feel it is better to have an optional range
properties. Lets take, ListHDFS, ListAzureBlob or ListS3 for example, over
time, the files accumulated under a particular location will grow
exponentially. Having property descriptors that mention the upper and lower
bound for the files, in this case, a time range - say 1/31/2016 -
2/26/2016, would be a nice to have feature. Thoughts?

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message