hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-13286) add a scale test to do gunzip and linecount
Date Fri, 17 Jun 2016 15:35:05 GMT
Steve Loughran created HADOOP-13286:
---------------------------------------

             Summary: add a scale test to do gunzip and linecount
                 Key: HADOOP-13286
                 URL: https://issues.apache.org/jira/browse/HADOOP-13286
             Project: Hadoop Common
          Issue Type: Sub-task
    Affects Versions: 2.8.0
            Reporter: Steve Loughran
            Assignee: Steve Loughran


the HADOOP-13203 patch proposal showed that there were performance problems downstream which
weren't surfacing in the current scale tests.

Trying to decompress the .gz test file and then go through it with LineReader models a basic
use case: parse a .csv.gz data source. 

Add this, with metric printing



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message