hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "jiraposter@reviews.apache.org (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-2440) make hive mapper initialize faster when having tons of input files
Date Fri, 09 Sep 2011 21:04:10 GMT

    [ https://issues.apache.org/jira/browse/HIVE-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13101563#comment-13101563
] 

jiraposter@reviews.apache.org commented on HIVE-2440:
-----------------------------------------------------


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/1783/
-----------------------------------------------------------

Review request for hive and Ning Zhang.


Summary
-------

when one hive job has tons of input files, a lot of mappers may fail because of slow initialization.


This addresses bug HIVE-2440.
    https://issues.apache.org/jira/browse/HIVE-2440


Diffs
-----

  trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/MapOperator.java 1167289 

Diff: https://reviews.apache.org/r/1783/diff


Testing
-------


Thanks,

Yongqiang



> make hive mapper initialize faster when having tons of input files
> ------------------------------------------------------------------
>
>                 Key: HIVE-2440
>                 URL: https://issues.apache.org/jira/browse/HIVE-2440
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: He Yongqiang
>            Assignee: He Yongqiang
>         Attachments: HIVE-2440.1.patch
>
>
> when one hive job has tons of input files, a lot of mappers may fail because of slow
initialization.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message