nifi-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] [nifi] naru014 commented on pull request #3511: NIFI-6175 Spark Livy - Improving Livy
Date Tue, 16 Jun 2020 06:40:39 GMT

naru014 commented on pull request #3511:
URL: https://github.com/apache/nifi/pull/3511#issuecomment-644564279


   > @naru014 Yes, it can. It also includes Batch processing controller service/processor.
The one that comes with NiFi currently has severe limitations. I keep forgetting to get this
one merged. I just need to update it for the latest version of NiFI.
   
   @patricker Thank you. We have got this build and included in the nifi. But when using a
livy session controller service per nifi flow, the flows in some cases dont use the session
created by the controller for that flow, but any other available session. Is this expected?
So currently instead of creating a livy session controller per flow, I have created one livy
session controller on the parent nifi-flow and it is inherited by all the child flows. By
doing that, the nifi cluster has say min 2 sessions available and is used by any running flow
based on its availability.
   Please let me know if there is a better way to use it.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



Mime
View raw message