hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bill Graham (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-538) make hive_jdbc.jar self-containing
Date Tue, 10 Aug 2010 00:17:23 GMT

    [ https://issues.apache.org/jira/browse/HIVE-538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12896746#action_12896746
] 

Bill Graham commented on HIVE-538:
----------------------------------

>From a purely empirical approach it appears that the following jars are currently required
to use the hive JDBC driver (version 0.5.0):

{noformat}
dist/lib/hive-exec-0.7.0.jar
dist/lib/hive-jdbc-0.7.0.jar
dist/lib/hive-metastore-0.7.0.jar
dist/lib/hive-service-0.7.0.jar
dist/lib/libfb303.jar
dist/lib/libthrift.jar

hadoop-core-{version}.jar
{noformat}

I propose modifying the build process to combine the classes from the first set of jars into
one single jar. That way users only need to add the hadoop-core jar and and hive-jdbc-combined
jar to their classpath. As other dependencies are removed or refactored away, we could thin
out what goes in the jar. 

I can take on this JIRA if others agree with the approach.




> make hive_jdbc.jar self-containing
> ----------------------------------
>
>                 Key: HIVE-538
>                 URL: https://issues.apache.org/jira/browse/HIVE-538
>             Project: Hadoop Hive
>          Issue Type: Improvement
>          Components: Clients
>    Affects Versions: 0.3.0, 0.3.1, 0.4.0, 0.6.0
>            Reporter: Raghotham Murthy
>
> Currently, most jars in hive/build/dist/lib and the hadoop-*-core.jar are required in
the classpath to run jdbc applications on hive. We need to do atleast the following to get
rid of most unnecessary dependencies:
> 1. get rid of dynamic serde and use a standard serialization format, maybe tab separated,
json or avro
> 2. dont use hadoop configuration parameters
> 3. repackage thrift and fb303 classes into hive_jdbc.jar

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message