hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Namit Jain (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (HIVE-2641) SkewJoin should report progress while writing skew keys to HDFS
Date Wed, 05 Dec 2012 07:18:58 GMT

     [ https://issues.apache.org/jira/browse/HIVE-2641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Namit Jain reassigned HIVE-2641:
--------------------------------

    Assignee: Namit Jain
    
> SkewJoin should report progress while writing skew keys to HDFS
> ---------------------------------------------------------------
>
>                 Key: HIVE-2641
>                 URL: https://issues.apache.org/jira/browse/HIVE-2641
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Namit Jain
>            Assignee: Namit Jain
>
> RowContainer.copyToDFSDirectory is used to write the skew keys to HDFS. But this can
take a long time, and while it is happening, the MR framework does not see progress from the
reducer. The code should do the copy in smaller unit and report progress to the MR framework

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message