nifi-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Otto Fowler <ottobackwa...@gmail.com>
Subject Re: [Suggestion] Add a configuration property for LivySessionController
Date Fri, 01 Nov 2019 10:59:49 GMT
You may want to look at https://github.com/apache/nifi/pull/3511 which is
open under review now and comment there. Maybe you can even try it and
review with feedback.




On November 1, 2019 at 05:16:58, Woojin Joe (jwj0831@gmail.com) wrote:

Hi, All
I'm Woojin Joe, a data analytics engineer in Lineplus.
Our team is trying to test Apache Nifi for the data ingestion pipeline
integrated with the Spark cluster.

I found that LivySessionController would be proper to integrate between
Nifi and Spark through Livy.
But there is none property to include `conf` for creating a session through
it.

Thus if possible, I'd like to include `conf` property as a JSON format in
LivySessionController.

IMO, it would take very trivial changes.
For example, just creating a new property descriptor and append `conf` in
the body when it is set.

[image: screenshot_code_diff.png]

I hope to contribute this feature to the current code base if possible.

Warm regards,
Woojin joe

----------------------------------------------------------------------


[image: --]
Woojin Joe
[image: http://]about.me/notforme
<http://about.me/notforme?promo=email_sig>

Woojin Joe (@JoeWoojin <https://twitter.com/JoeWooJin>, Github
<https://github.com/not-for-me>, LinkedIn
<https://www.linkedin.com/in/notforme>)
----------------------------------------------------------------------

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message