nifi-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Clay Teahouse <clayteaho...@gmail.com>
Subject wifi questions
Date Thu, 03 May 2018 02:45:49 GMT
Hello All,

1) Why would one need both nifi and Kafka in an environment, considering
that NiFi can handle back pressure, set up and deal with queues? I have an
environment where I would be collecting data via NiFi and I would need to
write the data to hdfs after some post processing. Can't I just process the
records in NiFi, change the format and write the data to HDFS via a NiFi
HDFS processor, PutHDFS?

2) Similarly, if I need to do some stream processing, can't I just pull the
data from NiFi processor via NiFiSpout, do the processing via some bolts,
and write the data to HDFS either via HDFS bolt or A NiFi HDFS processor?

Do I even need storm in the picture?

3) Is NiFi suited for microbatch processing? Would it be better to pull the
data from NiFi via spark streaming and do microbatching there? Which
approach is most performant and reliable?

thanks

Clay

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message