hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mostafa Mokhtar (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-8163) With dynamic partition pruning map operator that generates the partition filters is not vectorized
Date Wed, 17 Sep 2014 20:21:35 GMT
Mostafa Mokhtar created HIVE-8163:
-------------------------------------

             Summary: With dynamic partition pruning map operator that generates the partition
filters is not vectorized
                 Key: HIVE-8163
                 URL: https://issues.apache.org/jira/browse/HIVE-8163
             Project: Hive
          Issue Type: Bug
          Components: Tez
    Affects Versions: 0.14.0
            Reporter: Mostafa Mokhtar
            Assignee: Gunther Hagleitner
            Priority: Minor
             Fix For: vectorization-branch, 0.14.0


Vertex used to generate the partition pruning filters is not vectorized.

Sample from the plan :
{code}
    Vertices:
        Map 1 
            Map Operator Tree:
                TableScan
                  alias: d3
                  filterExpr: ((d_quarter_name) IN ('2000Q1', '2000Q2', '2000Q3') and d_date_sk
is not null) (type: boolean)
                  Statistics: Num rows: 73049 Data size: 81741831 Basic stats: COMPLETE Column
stats: NONE
                  Filter Operator
                    predicate: ((d_quarter_name) IN ('2000Q1', '2000Q2', '2000Q3') and d_date_sk
is not null) (type: boolean)
                    Statistics: Num rows: 18262 Data size: 20435178 Basic stats: COMPLETE
Column stats: NONE
                    Select Operator
                      expressions: d_date_sk (type: int)
                      outputColumnNames: _col0
                      Statistics: Num rows: 18262 Data size: 20435178 Basic stats: COMPLETE
Column stats: NONE
                      Reduce Output Operator
                        key expressions: _col0 (type: int)
                        sort order: +
                        Map-reduce partition columns: _col0 (type: int)
                        Statistics: Num rows: 18262 Data size: 20435178 Basic stats: COMPLETE
Column stats: NONE
                      Select Operator
                        expressions: _col0 (type: int)
                        outputColumnNames: _col0
                        Statistics: Num rows: 18262 Data size: 20435178 Basic stats: COMPLETE
Column stats: NONE
                        Group By Operator
                          keys: _col0 (type: int)
                          mode: hash
                          outputColumnNames: _col0
                          Statistics: Num rows: 18262 Data size: 20435178 Basic stats: COMPLETE
Column stats: NONE
                          Dynamic Partitioning Event Operator
                            Target Input: catalog_sales
                            Partition key expr: cs_sold_date_sk
                            Statistics: Num rows: 18262 Data size: 20435178 Basic stats: COMPLETE
Column stats: NONE
                            Target column: cs_sold_date_sk
                            Target Vertex: Map 3
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message