incubator-drill-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Hmxxyy <hmx...@gmail.com>
Subject Re: Drill 0.5.0 with Hive 0.12.0 on hadoop 2.5.0
Date Wed, 08 Oct 2014 05:13:55 GMT
The hive jars I used are 0.12.4 with hive 7620 fixed. Not 0.13.

Sent from my iPhone

> On Oct 7, 2014, at 9:46 PM, Venki Korukanti <venki.korukanti@gmail.com> wrote:
> 
> Current storage plugin is using Hive 0.12 APIs. From the build errors it
> looks like the version of hive jar that you replaced is >= 0.13.0. Hive
> 0.13 (and above) have few API changes compared Hive 0.12. In order to
> resolve the kerberos error use jars built from Apache Hive 0.12 source +
> HIVE-7620 patch.
> 
>> On Tue, Oct 7, 2014 at 8:57 PM, Li HM <hmxxyy@gmail.com> wrote:
>> 
>> after I replaced the hive jar in local maven repo, and change the
>> hadoop version from 2.4.1 to 2.5.0 in pom.xml.
>> 
>> The build failed with the following error:
>> 
>> [INFO] --- maven-compiler-plugin:3.0:compile (default-compile) @
>> drill-storage-hive-core ---
>> [INFO] Changes detected - recompiling the module!
>> [INFO] Compiling 34 source files to
>> /home/lih/incubator-drill/contrib/storage-hive/core/target/classes
>> [INFO] -------------------------------------------------------------
>> [ERROR] COMPILATION ERROR :
>> [INFO] -------------------------------------------------------------
>> [ERROR]
>> /home/lih/incubator-drill/contrib/storage-hive/core/src/main/java/org/apache/drill/exec/store/hive/HiveRecordReader.java:[192,29]
>> error: cannot find symbol
>> [ERROR]   symbol:   method appendReadColumnIDs(JobConf,List<Integer>)
>>  location: class ColumnProjectionUtils
>> 
>> /home/lih/incubator-drill/contrib/storage-hive/core/src/main/java/org/apache/drill/exec/store/hive/HiveRecordReader.java:[193,29]
>> error: appendReadColumnNames(Configuration,List<String>) has private
>> access in ColumnProjectionUtils
>> [ERROR]
>> /home/lih/incubator-drill/contrib/storage-hive/core/src/main/java/org/apache/drill/exec/store/hive/HiveRecordReader.java:[524,15]
>> error: constructor HiveDecimal in class HiveDecimal cannot be applied
>> to given types;
>> [ERROR]   required: BigDecimal
>>  found: String
>>  reason: actual argument String cannot be converted to BigDecimal by
>> method invocation conversion
>> 
>> /home/lih/incubator-drill/contrib/storage-hive/core/target/generated-sources/org/apache/drill/exec/expr/fn/impl/hive/DrillDecimal38SparseObjectInspector.java:[58,13]
>> error: HiveDecimal(BigDecimal) has private access in HiveDecimal
>> [ERROR]
>> /home/lih/incubator-drill/contrib/storage-hive/core/target/generated-sources/org/apache/drill/exec/expr/fn/impl/hive/DrillDecimal38SparseObjectInspector.java:[66,13]
>> error: HiveDecimal(BigDecimal) has private access in HiveDecimal
>> [ERROR]
>> /home/lih/incubator-drill/contrib/storage-hive/core/src/main/java/org/apache/drill/exec/expr/fn/HiveFunctionRegistry.java:[189,31]
>> error: no suitable constructor found for
>> GenericUDFBridge(String,boolean,Class<CAP#1>)
>> [INFO] 6 errors
>> [INFO] -------------------------------------------------------------
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Reactor Summary:
>> [INFO]
>> [INFO] Apache Drill Root POM ............................. SUCCESS
>> [18.888s]
>> [INFO] Drill Protocol .................................... SUCCESS
>> [26.133s]
>> [INFO] Common (Logical Plan, Base expressions) ........... SUCCESS
>> [26.195s]
>> [INFO] contrib/Parent Pom ................................ SUCCESS [1.563s]
>> [INFO] contrib/data/Parent Pom ........................... SUCCESS [0.970s]
>> [INFO] contrib/data/tpch-sample-data ..................... SUCCESS [9.590s]
>> [INFO] exec/Parent Pom ................................... SUCCESS [1.966s]
>> [INFO] exec/Java Execution Engine ........................ SUCCESS
>> [5:18.113s]
>> [INFO] contrib/hbase-storage-plugin ...................... SUCCESS
>> [22.751s]
>> [INFO] contrib/hive-storage-plugin/Parent Pom ............ SUCCESS [1.304s]
>> [INFO] contrib/hive-storage-plugin/hive-exec-shaded ...... SUCCESS
>> [28.498s]
>> [INFO] contrib/hive-storage-plugin/core .................. FAILURE
>> [12.699s]
>> [INFO] contrib/mongo-storage-plugin ...................... SKIPPED
>> [INFO] exec/JDBC Driver using dependencies ............... SKIPPED
>> [INFO] contrib/sqlline ................................... SKIPPED
>> [INFO] JDBC JAR with all dependencies .................... SKIPPED
>> [INFO] exec/Drill expression interpreter ................. SKIPPED
>> [INFO] Packaging and Distribution Assembly ............... SKIPPED
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] BUILD FAILURE
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Total time: 7:50.911s
>> [INFO] Finished at: Wed Oct 08 03:48:06 UTC 2014
>> [INFO] Final Memory: 72M/294M
>> [INFO]
>> ------------------------------------------------------------------------
>> [ERROR] Failed to execute goal
>> org.apache.maven.plugins:maven-compiler-plugin:3.0:compile
>> (default-compile) on project drill-storage-hive-core: Compilation
>> failure: Compilation failure:
>> [ERROR]
>> /home/lih/incubator-drill/contrib/storage-hive/core/src/main/java/org/apache/drill/exec/store/hive/HiveRecordReader.java:[192,29]
>> error: cannot find symbol
>> [ERROR] symbol:   method appendReadColumnIDs(JobConf,List<Integer>)
>> [ERROR] location: class ColumnProjectionUtils
>> [ERROR]
>> /home/lih/incubator-drill/contrib/storage-hive/core/src/main/java/org/apache/drill/exec/store/hive/HiveRecordReader.java:[193,29]
>> error: appendReadColumnNames(Configuration,List<String>) has private
>> access in ColumnProjectionUtils
>> [ERROR]
>> /home/lih/incubator-drill/contrib/storage-hive/core/src/main/java/org/apache/drill/exec/store/hive/HiveRecordReader.java:[524,15]
>> error: constructor HiveDecimal in class HiveDecimal cannot be applied
>> to given types;
>> [ERROR] required: BigDecimal
>> [ERROR] found: String
>> [ERROR] reason: actual argument String cannot be converted to
>> BigDecimal by method invocation conversion
>> [ERROR]
>> /home/lih/incubator-drill/contrib/storage-hive/core/target/generated-sources/org/apache/drill/exec/expr/fn/impl/hive/DrillDecimal38SparseObjectInspector.java:[58,13]
>> error: HiveDecimal(BigDecimal) has private access in HiveDecimal
>> [ERROR]
>> /home/lih/incubator-drill/contrib/storage-hive/core/target/generated-sources/org/apache/drill/exec/expr/fn/impl/hive/DrillDecimal38SparseObjectInspector.java:[66,13]
>> error: HiveDecimal(BigDecimal) has private access in HiveDecimal
>> [ERROR]
>> /home/lih/incubator-drill/contrib/storage-hive/core/src/main/java/org/apache/drill/exec/expr/fn/HiveFunctionRegistry.java:[189,31]
>> error: no suitable constructor found for
>> GenericUDFBridge(String,boolean,Class<CAP#1>)
>> [ERROR] -> [Help 1]
>> [ERROR]
>> [ERROR] To see the full stack trace of the errors, re-run Maven with
>> the -e switch.
>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>> [ERROR]
>> [ERROR] For more information about the errors and possible solutions,
>> please read the following articles:
>> [ERROR] [Help 1]
>> http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
>> [ERROR]
>> [ERROR] After correcting the problems, you can resume the build with the
>> command
>> [ERROR]   mvn <goals> -rf :drill-storage-hive-core
>> 
>> On Mon, Oct 6, 2014 at 11:07 PM, Venki Korukanti
>> <venki.korukanti@gmail.com> wrote:
>>> Hi,
>>> 
>>> Hive 0.12 with kerberos is incompatible with Hadoop 2.5.0 due to API
>>> changes in Hadoop 2.5.0. More details are here:
>>> https://issues.apache.org/jira/browse/HIVE-7620. One way to make it
>> work is
>>> port HIVE-7620 patch to hive 0.12, build Hive and install hive jars in
>>> local maven repo, then build drill which picks ups hive jars in local
>> maven
>>> repo.
>>> 
>>> Thanks
>>> Venki
>>> 
>>>> On Mon, Oct 6, 2014 at 10:21 PM, Li HM <hmxxyy@gmail.com> wrote:
>>>> 
>>>> Does Drill support Hive 0.12.0 on top of hadoop 2.5.0 with kerberos?
>>>> 
>>>> Anybody ever made it work?
>> 

Mime
View raw message