hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "eagooqi (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-12093) launch local task to process map join cost long time
Date Fri, 30 Oct 2015 02:02:27 GMT

    [ https://issues.apache.org/jira/browse/HIVE-12093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14981716#comment-14981716
] 

eagooqi commented on HIVE-12093:
--------------------------------

https://issues.apache.org/jira/browse/HADOOP-12217
this issue can cause mapjoin very slowlly when MapJoinKeyObject is org.apache.hadoop.hive.serde2.io.DoubleWritable
extends org.apache.hadoop.io.DoubleWritable 


>  launch local task to process map join cost long time 
> ------------------------------------------------------
>
>                 Key: HIVE-12093
>                 URL: https://issues.apache.org/jira/browse/HIVE-12093
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 1.2.1
>            Reporter: liuchuanqi
>
>  launch local task to process map join cost long time   
> 2015-10-08 19:34:35 INFO 2015-10-08 19:34:35  Starting to launch local task to process
map join;  maximum memory = 1908932608
> 2015-10-08 20:07:43 INFO 2015-10-08 20:07:43  Dump the side-table for tag: 1 with group
count: 148024 into file: file:/tmp/test/6b99a4b8-0db3-4c62-a0f3-20547504b2b4/hive_2015-10-08_19-30-11_948_5184081524408167915-1/-local-10015/HashTable-Stage-33/MapJoin-mapfile71--.hashtable
> 2015-10-08 20:07:43 INFO 2015-10-08 20:07:43  Uploaded 1 File to: file:/tmp/test/6b99a4b8-0db3-4c62-a0f3-20547504b2b4/hive_2015-10-08_19-30-11_948_5184081524408167915-1/-local-10015/HashTable-Stage-33/MapJoin-mapfile71--.hashtable
(8922201 bytes)
> 2015-10-08 20:07:43 INFO 2015-10-08 20:07:43  End of local task; Time Taken: 1987.642
sec.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message