incubator-hcatalog-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas" <...@yahoo-inc.com>
Subject Review Request: Patch to make HCatalog compile with Hadoop 0.23
Date Fri, 16 Dec 2011 18:49:43 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/3234/
-----------------------------------------------------------

Review request for hcatalog, Ashutosh Chauhan and Sushanth Sowmyan.


Summary
-------

Introduce shim layer for HCatalog to compile against 0.23. 
Depends on HIVE-2629 (requires patch under hive/external until committed).
Modify build to chain Hadoop dependency for Hive and HCat. 
HCatalog code will only run on either 0.20 or 0.23, depending on build time choice (same as
Pig). 
By default builds against 0.20
To build against 0.23:  ant -Dshims.name=23  clean test


This addresses bug HCATALOG-179.
    https://issues.apache.org/jira/browse/HCATALOG-179


Diffs
-----

  trunk/build-common.xml 1213383 
  trunk/build.xml 1213383 
  trunk/shims/src/20S/java/org/apache/hcatalog/shims/HCatHadoopShims20S.java PRE-CREATION

  trunk/shims/src/23/java/org/apache/hcatalog/shims/HCatHadoopShims23.java PRE-CREATION 
  trunk/src/java/org/apache/hcatalog/mapreduce/FileOutputCommitterContainer.java 1213383 
  trunk/src/java/org/apache/hcatalog/pig/HCatStorer.java 1213383 
  trunk/src/java/org/apache/hcatalog/shims/HCatHadoopShims.java PRE-CREATION 
  trunk/src/test/org/apache/hcatalog/rcfile/TestRCFileInputStorageDriver.java 1213383 
  trunk/src/test/org/apache/hcatalog/rcfile/TestRCFileMapReduceInputFormat.java 1213383 
  trunk/src/test/org/apache/hcatalog/rcfile/TestRCFileOutputStorageDriver.java 1213383 

Diff: https://reviews.apache.org/r/3234/diff


Testing
-------

Unit tests pass for 0.20
Some unit tests fail for 0.23 - Pig dependency fails unit test (no 0.23 build of Pig pulled
from maven).


Thanks,

Thomas


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message