incubator-hcatalog-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Travis Crawford <traviscrawf...@gmail.com>
Subject Re: Which jars to store to HCatalog in Pig?
Date Mon, 11 Jun 2012 23:50:21 GMT
I'd say register all the hive stuff, plus hcat.jar. If there's a
straightforward way to reduce the registered jars that would be
awesome, but this approach will work.

--travis


On Mon, Jun 11, 2012 at 4:47 PM, Russell Jurney
<russell.jurney@gmail.com> wrote:
> Writing docs, actually :) Didn't want to do it by trial and error.
>
> Russell Jurney
> twitter.com/rjurney
> russell.jurney@gmail.com
> datasyndrome.com
>
> On Jun 11, 2012, at 4:37 PM, Travis Crawford <traviscrawford@gmail.com> wrote:
>
>> Good question - I don't know myself what the minimum set are. On
>> trunk, after running "ant clean package" we see the following jars:
>>
>> $ find build/hcatalog-0.5.0-dev -name '*.jar'
>> build/hcatalog-0.5.0-dev/share/hcatalog/hcatalog-0.5.0-dev.jar
>> build/hcatalog-0.5.0-dev/share/hcatalog/hcatalog-server-extensions-0.5.0-dev.jar
>> build/hcatalog-0.5.0-dev/share/hcatalog/lib/hbase-storage-handler-0.1.0.jar
>> build/hcatalog-0.5.0-dev/share/hcatalog/storage-handlers/hbase/lib/hbase-storage-handler-0.1.0.jar
>>
>> I think you just want to:
>>
>> register /path/to/hcatalog.jar;
>> register /path/to/hive/lib/*.jar;
>>
>> Likely you don't need a lot of those though (datanucleus jumps to mind).
>>
>> Is this a curiosity, or are you running into issues?
>>
>> --travis
>>
>>
>>
>> On Mon, Jun 11, 2012 at 3:46 PM, Russell Jurney
>> <russell.jurney@gmail.com> wrote:
>>> Which jars need to be loaded to store to HCatalog from Pig?  I'm reading
>>> lots of docs:
>>>
>>> http://incubator.apache.org/hcatalog/docs/r0.2.0/loadstore.html
>>> http://incubator.apache.org/hcatalog/docs/r0.4.0/api/org/apache/hcatalog/pig/package-summary.html
>>> https://cwiki.apache.org/confluence/display/HCATALOG/How+To+Test
>>> http://developer.yahoo.com/blogs/hadoop/posts/2011/04/hcatalog-tables-and-metadata-for-hadoop/
>>> http://docs.hortonworks.com/HCatalog_Documentation/index.pdf
>>> http://incubator.apache.org/hcatalog/docs/r0.4.0/inputoutput.html
>>>
>>> But I can't find this, and there are a LOT of jars in HCatalog :)
>>>
>>> --
>>> Russell Jurney twitter.com/rjurney russell.jurney@gmail.com datasyndrome.com

Mime
View raw message