hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Muthu Pandi <muthu1...@gmail.com>
Subject Re: Can't integrate Elasticsearch with Hive
Date Fri, 28 Nov 2014 07:20:14 GMT
How did you get elasticsearch jar??

Try to build the jar against your version and use that jar.



*RegardsMuthupandi.K*

 Think before you print.



On Fri, Nov 28, 2014 at 12:23 PM, Atul Paldhikar (apaldhik) <
apaldhik@cisco.com> wrote:

>  Thanks Muthu for pointing out the issue.
>
>
>
> However unfortunately I am back to the same old issue while accessing the
> external table. I am getting the following exception again, there wasn’t
> any change in the environment.
>
>
>
> I tried all the cleanup but still no luck :-( Here are the steps I tried
>
>
>
> 1. Removed the other jar for es-hadoop 2.1.x completely from the server
>
>
>
> 2. Updated the hive-site.xml as below, but didn't work
>
>
>
> <property>
>
>   <name>hive.aux.jars.path</name>
>
>
> <value>/apps/sas/elasticsearch-hadoop-2.0.2/dist/elasticsearch-hadoop-2.0.2.jar</value>
>
>   <description>A comma separated list (with no spaces) of the jar
> files</description>
>
> </property>
>
>
>
> 3. Added the jar file in the hiveconf as below, still the same issue
>
>
>
> hive --hiveconf
> hive.aux.jars.path=/apps/sas/elasticsearch-hadoop-2.0.2/dist/elasticsearch-hadoop-2.0.2.jar
>
>
>
> 4. Tried adding the jar file in the hive session, still didn't work
>
>
>
> add jar
> /apps/sas/elasticsearch-hadoop-2.0.2/dist/elasticsearch-hadoop-2.0.2.jar;
>
>
>
> Thanks
>
> - Atul
>
>
>
> ERROR:
>
>
>
> 2014-11-26 23:09:22,069 ERROR [main]: exec.DDLTask
> (DDLTask.java:execute(478)) - java.lang.IllegalAccessError: tried to access
> class org.elasticsearch.hadoop.hive.HiveUtils from class
> org.elasticsearch.hadoop.hive.EsSerDe
>
>         at
> org.elasticsearch.hadoop.hive.EsSerDe.initialize(EsSerDe.java:81)
>
>         at
> org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:339)
>
>         at
> org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:288)
>
>         at
> org.apache.hadoop.hive.ql.metadata.Table.getDeserializer(Table.java:281)
>
>         at org.apache.hadoop.hive.ql.metadata.Table.getCols(Table.java:631)
>
>         at
> org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:593)
>
>         at
> org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:4189)
>
>         at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:281)
>
>         at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:153)
>
>         at
> org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:85)
>
>         at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1503)
>
>         at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1270)
>
>         at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1088)
>
>         at org.apache.hadoop.hive.ql.Driver.run(Driver.java:911)
>
>         at org.apache.hadoop.hive.ql.Driver.run(Driver.java:901)
>
>         at
> org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:268)
>
>         at
> org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:220)
>
>         at
> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:423)
>
>         at
> org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:792)
>
>         at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:686)
>
>         at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625)
>
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>
>         at java.lang.reflect.Method.invoke(Method.java:606)
>
>         at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
>
>
>
> 2014-11-26 23:09:22,069 ERROR [main]: ql.Driver
> (SessionState.java:printError(545)) - FAILED: Execution Error, return code
> 1 from org.apache.hadoop.hive.ql.exec.DDLTask. tried to access class
> org.elasticsearch.hadoop.hive.HiveUtils from class
> org.elasticsearch.hadoop.hive.EsSerDe
>
>
>
> *From:* Muthu Pandi [mailto:muthu1086@gmail.com]
> *Sent:* Thursday, November 27, 2014 9:08 PM
> *To:* user@hive.apache.org
> *Subject:* Re: Can't integrate Elasticsearch with Hive
>
>
>
> Hi Atul
>
>
>
>      Check your typo "tblproperties('es.resources' = 'employee/address')
> " need to be "es.resource" as it rightly indicated in the Error.
>
>
>
> *Regards Muthupandi.K*
>
> *[image: Image removed by sender.]* Think before you print.
>
>
>
>
>
> On Fri, Nov 28, 2014 at 3:43 AM, Edward Capriolo <edlinuxguru@gmail.com>
> wrote:
>
> Because the elastic search storage handler is not part of hive you might
> be able to find more help asking the author of the storage handler. From
> the errors you are reporting it likely does not work and not tested against
> this version of hive.
>
>
>

Mime
View raw message