flume-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Theodore michael Malaska (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLUME-3020) Improve HDFSEventSink Escape Ingestion by more then 10x by not getting InetAddress on every record
Date Tue, 01 Nov 2016 14:35:58 GMT
Theodore michael Malaska created FLUME-3020:
-----------------------------------------------

             Summary: Improve HDFSEventSink Escape Ingestion by more then 10x by not getting
InetAddress on every record
                 Key: FLUME-3020
                 URL: https://issues.apache.org/jira/browse/FLUME-3020
             Project: Flume
          Issue Type: Improvement
            Reporter: Theodore michael Malaska


If you are use escaping the current code will call InetAddress on every record.  Which will
result is a huge impact to performance.

TotalTime,8403,
totalEventTakeTime,1498,
totalWriteTime,1981,
totalWriterSetupTime,65,
commitTime,201,
flushTime,18,
startTrans,7,

The rest is all InetAddress



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message