hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thejas M Nair (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-538) make hive_jdbc.jar self-containing
Date Tue, 29 Apr 2014 02:23:15 GMT

    [ https://issues.apache.org/jira/browse/HIVE-538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983886#comment-13983886
] 

Thejas M Nair commented on HIVE-538:
------------------------------------

The hadoop dependencies for jdbc client are needed only when kerberos authentication is used.
However, it is a small set of hadoop jars that are needed, and their transitive dependencies
are not needed. In case of hadoop 1.x, it is just hadoop-core*jar that is needed. I am not
sure of the exact dependency in hadoop-2.x .

I am fine with option 1. But if we can do option 3, with the minimal set of hadoop jars requried,
that would be awesome.


> make hive_jdbc.jar self-containing
> ----------------------------------
>
>                 Key: HIVE-538
>                 URL: https://issues.apache.org/jira/browse/HIVE-538
>             Project: Hive
>          Issue Type: Improvement
>          Components: JDBC
>    Affects Versions: 0.3.0, 0.4.0, 0.6.0, 0.13.0
>            Reporter: Raghotham Murthy
>            Assignee: Nick White
>         Attachments: ASF.LICENSE.NOT.GRANTED--HIVE-538.D2553.1.patch, ASF.LICENSE.NOT.GRANTED--HIVE-538.D2553.2.patch,
HIVE-538.patch
>
>
> Currently, most jars in hive/build/dist/lib and the hadoop-*-core.jar are required in
the classpath to run jdbc applications on hive. We need to do atleast the following to get
rid of most unnecessary dependencies:
> 1. get rid of dynamic serde and use a standard serialization format, maybe tab separated,
json or avro
> 2. dont use hadoop configuration parameters
> 3. repackage thrift and fb303 classes into hive_jdbc.jar



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message