nifi-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From satish <>
Subject Mechanism to notify completion of processes across cluster
Date Thu, 21 Dec 2017 06:49:19 GMT
Hi I have followed   pierrevillard
blog  to  move files from sftp to hdfs.

I have facing problem in my current workflow which is running on clustered
NiFi. My workflow is LISTSFTP(on
INSERT_INTO_MANAGED_TABLE(on PrimaryNode) . Everything is fine until
PUTHDFS. But I have facing problem in creating the external table in hive,
as I need to wait all PUTHDFS processes ( which are spanned across cluster)
have completed before triggering external table processor. How can I achieve

Whether wait and notify processes can resolve this issue or else I need to
implement using RPG?

Sent from:

View raw message