nifi-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Joe Witt <joe.w...@gmail.com>
Subject Re: Is this possible to increase speed of processors in NiFi?
Date Sat, 11 Feb 2017 04:57:56 GMT
For processors that support it consider using a 'run duration of 25
milliseconds'.  This allows the framework to batch many operations
into fewer transactions which can dramatically increase throughput.

100% memory usage is a problem.  Increase heap size or consider
redesign/simplifying your flow.

100% disk usage should be addressed.  Ensure each repository is on a
physically separate partition.  If this is not possible then keep in
mind they will create congestion for eachother or consider switching
to a volatile provenance repository.

Review the flow for processors which load content fully into memory.
This can harm performance greatly.

On Fri, Feb 10, 2017 at 11:42 PM, prabhu Mahendran
<prabhuu161994@gmail.com> wrote:
>
> Since each processor have concurrent tasks if i have set the concurrent
> tasks for processors then it boosts processing speed of processors.But it
> affects the System performance such as 100% Disk Usage,100% Memory
> Usage..etc
>
> Is there is any other way to speed up processors without use concurrent
> tasks?

Mime
View raw message