nifi-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Joe Witt <joe.w...@gmail.com>
Subject Re: Flow file replication
Date Tue, 22 Nov 2016 17:37:27 GMT
Hello Nicolas

So today if a NiFi node dies the data should still be recoverable unless
the disks/storage itself is dead.  So losing a node should not cause data
loss but it does impact availability.

Currently the way to achieve rapid availability in the presence of node
failure would be through having the key repositories (content, flowfile,
provenance) all mounted in such a way that you could remount them to
another host.  This is a typical infrastructure/OS level approach that can
be managed outside of NiFi itself.  It is admittedly non-trivial to get
right.

However, there have been discussions on making this a first class feature
of nifi itself.
https://cwiki.apache.org/confluence/display/NIFI/Data+Replication

Thanks
Joe



On Tue, Nov 22, 2016 at 12:30 PM, Provenzano Nicolas <
nicolas.provenzano@gfi.fr> wrote:

> Hi all,
>
>
>
> Is there a way to replicate the repositories in order to be able to resume
> the processing of data when a nodes crashes ?
>
>
>
> What is the recommendation to avoid losing data in case a node crashes ?
>
>
>
> Thanks in advance
>
>
>
> BR
>
>
>
> Nicolas
>
>
>
> —
> Gfi Informatique Telecom
> *Nicolas Provenzano*
>
> BU Telecom / Customer Experience
>
> *nicolas.provenzano@gfi.fr <nicolas.provenzano@gfi.fr>*
> —
> 2 rue Andras Beck – 92360 Meudon La Forêt
> Tél. : +33 (0)1 46 83 35 06
> Mob. : +33 (0)6 82 07 19 21
> www.gfi.world
> —
> [image: signature-img]
>
>
>

Mime
View raw message