flume-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rui Pan (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLUME-3191) When flume collected files are linked file, and the link file points to a real file, it will lead to open the file too much exception.
Date Tue, 07 Nov 2017 07:05:00 GMT
Rui Pan created FLUME-3191:
------------------------------

             Summary: When flume collected files are linked file, and the link file points
to a real file, it will lead to open the file too much exception.
                 Key: FLUME-3191
                 URL: https://issues.apache.org/jira/browse/FLUME-3191
             Project: Flume
          Issue Type: Bug
          Components: Sinks+Sources
    Affects Versions: 1.7.0
         Environment: centos6.7
            Reporter: Rui Pan


When flume collected files are linked file, and the link file points to a real file, it will
lead to open the file too much exception.
The following codes in ReliableTaildirEventReader.java, will create unmanaged object which
contain file handle.

{code:java}
 long inode = getInode(f);
        TailFile tf = tailFiles.get(inode);
        if (tf == null || !tf.getPath().equals(f.getAbsolutePath())) {
          long startPos = skipToEnd ? f.length() : 0;
          tf = openFile(f, headers, inode, startPos);
        }
{code}




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message