hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-13286) add a scale test to do gunzip and linecount
Date Fri, 17 Jun 2016 15:35:05 GMT
Steve Loughran created HADOOP-13286:

             Summary: add a scale test to do gunzip and linecount
                 Key: HADOOP-13286
                 URL: https://issues.apache.org/jira/browse/HADOOP-13286
             Project: Hadoop Common
          Issue Type: Sub-task
    Affects Versions: 2.8.0
            Reporter: Steve Loughran
            Assignee: Steve Loughran

the HADOOP-13203 patch proposal showed that there were performance problems downstream which
weren't surfacing in the current scale tests.

Trying to decompress the .gz test file and then go through it with LineReader models a basic
use case: parse a .csv.gz data source. 

Add this, with metric printing

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message