hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Suma Shivaprasad" <sumasai.shivapra...@gmail.com>
Subject Review Request 24497: HIVE-7629 - Map joins between two parquet tables failing
Date Fri, 08 Aug 2014 06:21:59 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/24497/
-----------------------------------------------------------

Review request for hive.


Bugs: HIVE-7629
    https://issues.apache.org/jira/browse/HIVE-7629


Repository: hive-git


Description
-------

Map Joins between 2 parquet tables are failing since the Mapper is trying to access the columns
of the first table(bigger table) while trying to load the  second table(smaller map join table).
Fixed this by adding a guard on the column indexes passed by hive


Diffs
-----

  ql/src/java/org/apache/hadoop/hive/ql/io/parquet/ProjectionPusher.java 2f155f6 
  ql/src/java/org/apache/hadoop/hive/ql/io/parquet/read/DataWritableReadSupport.java d6be4bd

  ql/src/test/queries/clientpositive/parquet_join.q PRE-CREATION 
  ql/src/test/results/clientpositive/parquet_join.q.out PRE-CREATION 

Diff: https://reviews.apache.org/r/24497/diff/


Testing
-------

parquet_join.q covers most types of joins between 2 parquet tables - Normal, Map join, SMB
join


Thanks,

Suma Shivaprasad


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message