nifi-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Joe Witt (Jira)" <j...@apache.org>
Subject [jira] [Commented] (NIFI-7114) NiFi not closing file handles
Date Fri, 21 Feb 2020 16:41:00 GMT

    [ https://issues.apache.org/jira/browse/NIFI-7114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17042017#comment-17042017
] 

Joe Witt commented on NIFI-7114:
--------------------------------

What I'm seeing grow is the number of FIFO by 2 and the number unix type descriptors.  I see
this by running the following command over and over

lsof +E -P -p 230830 | tr -s " " | cut -d" " -f5 | sort | uniq -c
   41 a_inode
   7 CHR
   4 DIR
   86 FIFO
   9 IPv4
  5737 REG
   1 TYPE
   33 unix

So now it is about seeing precisely which file descriptors relevant to FIFO/unix are changing
in those sets.

So I run the following command a couple times over time to generate new output in diff files.

lsof +E -P -p 230830 | tr -s " " | grep -v CHR | grep -v DIR | grep -v IPv4 | grep -v REG
| grep -v TYPE | sort | tee ~/Downloads/debug-pipes-1134.txt

Then diff.

Get something like

171a172
> java 230830 nifi 3051u a_inode 0,14 0 15578 [eventpoll]
173a175
> java 230830 nifi 3056u unix 0x00000000c69364e8 0t0 30110755 type=STREAM
175,177c177,181
< java 230830 nifi 3058r FIFO 0,13 0t0 25310688 pipe 230830,java,3059w
< java 230830 nifi 3059w FIFO 0,13 0t0 25310688 pipe 230830,java,3058r
< java 230830 nifi 3060u a_inode 0,14 0 15578 [eventpoll]
---
> java 230830 nifi 3058r FIFO 0,13 0t0 25310689 pipe 230830,java,3062w
> java 230830 nifi 3060r FIFO 0,13 0t0 25295731 pipe 230830,java,3061w
> java 230830 nifi 3061w FIFO 0,13 0t0 25295731 pipe 230830,java,3060r
> java 230830 nifi 3062w FIFO 0,13 0t0 25310689 pipe 230830,java,3058r
> java 230830 nifi 3065u a_inode 0,14 0 15578 [eventpoll]


> NiFi not closing file handles
> -----------------------------
>
>                 Key: NIFI-7114
>                 URL: https://issues.apache.org/jira/browse/NIFI-7114
>             Project: Apache NiFi
>          Issue Type: Bug
>          Components: Configuration
>    Affects Versions: 1.10.0, 1.11.0
>         Environment: Amazon EC2 running either Amazon Linux 2 or Ubuntu 18.04.
> NiFi has been installed with no change to any configuration file.
>            Reporter: Vinicius Zolin
>            Priority: Major
>         Attachments: destination.xml, fifocounts.txt, flow.xml.gz, lsof.log, lsof.zip,
lsofAfter.log, lsofBefore.log, openFiles.xlsx, reproduction.zip, source.xml
>
>
> Since at least version 1.10 NiFi stopped closing file handles. It opens circa 500 files
per hour (measured using lsof) without any apparent limit until it crashes due to too many
open files.
>  
> Increasing the computer open file limit is not a solution since NiFi will still crash,
it'll only take longer to do so.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message