nifi-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matt Gilman (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (NIFI-1414) TailFile can cause Too Many Open Files if Rolling Filename Pattern used
Date Wed, 20 Jan 2016 22:08:39 GMT

    [ https://issues.apache.org/jira/browse/NIFI-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15109581#comment-15109581
] 

Matt Gilman commented on NIFI-1414:
-----------------------------------

+1 Looks good!

> TailFile can cause Too Many Open Files if Rolling Filename Pattern used
> -----------------------------------------------------------------------
>
>                 Key: NIFI-1414
>                 URL: https://issues.apache.org/jira/browse/NIFI-1414
>             Project: Apache NiFi
>          Issue Type: Bug
>          Components: Extensions
>            Reporter: Mark Payne
>            Assignee: Mark Payne
>             Fix For: 0.5.0
>
>         Attachments: 0001-NIFI-1414-Ensure-that-the-DirectoryStream-is-closed-.patch
>
>
> When using the TailFile processor, if the Rolling Filename Pattern is set, the Processor
does not appear to properly close the file handles that it creates for the directory. As a
result, if the Processor runs long enough, we start to see "IOException: Too many open files",
which causes a lot of problems and requires a restart of NiFi.
> Performing an "lsof" while running TailFile to tail the logs in my logs directory results
in 10's of thousands of entries like:
> java      14549 ec2-user *703r      DIR              202,1      4096    787749 /opt/nifi/nifi-0.4.2-SNAPSHOT/logs
> java      14549 ec2-user *704r      DIR              202,1      4096    787749 /opt/nifi/nifi-0.4.2-SNAPSHOT/logs
> java      14549 ec2-user *705r      DIR              202,1      4096    787749 /opt/nifi/nifi-0.4.2-SNAPSHOT/logs
> java      14549 ec2-user *706r      DIR              202,1      4096    787749 /opt/nifi/nifi-0.4.2-SNAPSHOT/logs
> java      14549 ec2-user *707r      DIR              202,1      4096    787749 /opt/nifi/nifi-0.4.2-SNAPSHOT/logs
> java      14549 ec2-user *708r      DIR              202,1      4096    787749 /opt/nifi/nifi-0.4.2-SNAPSHOT/logs
> java      14549 ec2-user *709r      DIR              202,1      4096    787749 /opt/nifi/nifi-0.4.2-SNAPSHOT/logs
> java      14549 ec2-user *710r      DIR              202,1      4096    787749 /opt/nifi/nifi-0.4.2-SNAPSHOT/logs



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message