nifi-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinicius Zolin (Jira)" <j...@apache.org>
Subject [jira] [Commented] (NIFI-7114) NiFi not closing file handles
Date Mon, 10 Feb 2020 18:52:00 GMT

    [ https://issues.apache.org/jira/browse/NIFI-7114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17033849#comment-17033849
] 

Vinicius Zolin commented on NIFI-7114:
--------------------------------------

I've annexed 4 files to help with this issue.

[^lsofBefore.log] and [^lsofAfter.log] are lsof output some hours apart. Those are not the
best examples but I will reboot NiFI and collect better data.

 

[^source.xml] and [^destination.xml] are the flows that I'm using. Those should help replicating
the problem.

Source is just a sample flow generating provenance records to be parsed by destination.

Source will not show the problem, but destination should.

> NiFi not closing file handles
> -----------------------------
>
>                 Key: NIFI-7114
>                 URL: https://issues.apache.org/jira/browse/NIFI-7114
>             Project: Apache NiFi
>          Issue Type: Bug
>          Components: Configuration
>    Affects Versions: 1.10.0, 1.11.0
>         Environment: Amazon EC2 running either Amazon Linux 2 or Ubuntu 18.04.
> NiFi has been installed with no change to any configuration file.
>            Reporter: Vinicius Zolin
>            Priority: Major
>             Fix For: 1.8.0
>
>         Attachments: destination.xml, lsof.log, lsofAfter.log, lsofBefore.log, source.xml
>
>
> Since at least version 1.10 NiFi stopped closing file handles. It opens circa 500 files
per hour (measured using lsof) without any apparent limit until it crashes due to too many
open files.
>  
> Increasing the computer open file limit is not a solution since NiFi will still crash,
it'll only take longer to do so.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message