nifi-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jeff - Data Bean Australia <>
Subject Re: Does NiFi support Hot Deploy?
Date Tue, 16 Feb 2016 02:39:06 GMT
Thanks Joe for the clarification. And it does make sense to me with runtime
reliability and change requirement in enterprise environment.

I know that there are solutions that put multiple NiFi instances working
together. How common a solution like this in real world? Should we,
generally speaking, prefer simple flow.xml configuration and combine NiFi
instances together for more complex scenarios?

On Tue, Feb 16, 2016 at 3:16 PM, Joe Witt <> wrote:

> Jeff,
> Regarding hot deploy of new dataflows:
> Absolutely.  The ability to have interactive command and control is a
> key feature/concept of NiFi so you can certainly create, alter, remove
> dataflows while the systems is running by design.  This isn't just for
> a person controlling the flow through  UI but also for external
> systems to have automated interactions with NiFi through its REST API
> which can do things like change the flow, alter priorities, etc..
> Regarding hot deploy of new code/extensions:
> We've avoided live deploy of new extensions to this point.  Largely
> due to the understanding that while adding new extensions at runtime
> is pretty doable it is less reliable/clear to change/update.  That
> said, we're trending toward this registry and it would back versions
> of extensions at which point maybe this becomes more reasonable.
> Anyway, in the mean time one option may be the fact that the
> ExecuteScript,InvokeScriptedProcessor processors do support live
> alteration of the code behind them.  While clearly not a complete
> solution this may help with some of your cases.
> Thanks
> Joe
> On Mon, Feb 15, 2016 at 9:10 PM, Jeff - Data Bean Australia
> <> wrote:
> > Here is my use case: I have a quite complex Data Flow system implemented
> by
> > NiFi and keep streaming data to another system. There is part of the
> system
> > I might want to update on-the-fly without turning down the whole NiFi
> > platform. And occasionally I might want to add a new processor, or
> upgrade
> > an existing one, then bring up this processor right away.
> >
> > Can I do it in NiFi now?
> >
> > Thanks,
> > Jeff
> >
> > --
> > Data Bean - A Big Data Solution Provider in Australia.

Data Bean - A Big Data Solution Provider in Australia.

View raw message