hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Brock Noland (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-8486) TPC-DS Query 96 parallelism is not set correcly
Date Thu, 16 Oct 2014 21:27:34 GMT

    [ https://issues.apache.org/jira/browse/HIVE-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14174277#comment-14174277
] 

Brock Noland commented on HIVE-8486:
------------------------------------

Thanks Chao! Two questions:

1) Can we fix this the calculation described above?
2) Why are we estimating a single reducer in the normal case? The join covers the entire store_sales
table which is 2.2GB. Perhap we need to add some debug statements to SetSparkReducerParallelism?

> TPC-DS Query 96 parallelism is not set correcly
> -----------------------------------------------
>
>                 Key: HIVE-8486
>                 URL: https://issues.apache.org/jira/browse/HIVE-8486
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Spark
>            Reporter: Brock Noland
>            Assignee: Chao
>
> When we run the query on a 20B we only have a parallelism factor of 1.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message