hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Saurabh Malviya (samalviy)" <samal...@cisco.com>
Subject RE: Hbase Es -Quava lib conflict
Date Thu, 21 Jul 2016 18:23:26 GMT
With Shaded client it is not able to find  below class

import org.apache.hadoop.hbase.mapred.TableOutputFormat


-----Original Message-----
From: Sean Busbey [mailto:busbey@cloudera.com] 
Sent: Wednesday, July 20, 2016 12:00 PM
To: user <user@hbase.apache.org>
Subject: Re: Hbase Es -Quava lib conflict

why do you have a dependency on o.a.hbase:hbase, o.a.hbase:hbase-server, and o.a.hbase:hbase-common?
If you have those, then the shaded client won't do you any good. You should only need the
hbase-shaded-client artifact.

There hasn't been a CDH release with a functioning shaded client yet.
AFAIK, the first ones will be 1.2.0-cdh5.7.2 and 1.2.0-cdh5.8.0. What version is the cluster
you are trying to work with?

On Wed, Jul 20, 2016 at 1:15 PM, Saurabh Malviya (samalviy) <samalviy@cisco.com> wrote:
> This is my sbt looks like
>
> val hbaseVersion = "1.0.0-cdh5.5.0"
>
>   "org.apache.hbase" % "hbase" % hbaseVersion,
>   "org.apache.hbase" % "hbase-server" % hbaseVersion,
>   "org.apache.hbase" % "hbase-client" % hbaseVersion, -- > Used shaded client as well
not working (Used all version upto 1.2.1)
>   "org.apache.hbase" % "hbase-common" % hbaseVersion,
>   "org.elasticsearch" % "elasticsearch-hadoop" % "5.0.0-alpha4" % "compile",
>   "org.elasticsearch" % "elasticsearch" % "2.3.3",
>   "com.google.guava" % "guava" % "18.0" --> This is the culprit -IF I remove this
elastic search will not work.
>
>
> -----Original Message-----
> From: Sean Busbey [mailto:busbey@cloudera.com]
> Sent: Wednesday, July 20, 2016 10:25 AM
> To: user <user@hbase.apache.org>
> Subject: Re: Hbase Es -Quava lib conflict
>
> how are you making use of hbase shaded client? that module should remove this issue entirely.
>
> On Tue, Jul 19, 2016 at 5:50 PM, Saurabh Malviya (samalviy) <samalviy@cisco.com>
wrote:
>> Hi,
>>
>> I am addressing one issue to make Hbase and ES work together in same 
>> spark project
>>
>> https://community.cloudera.com/t5/Storage-Random-Access-HDFS/Apache-H
>> B
>> ase-Shaded-Client-1-1-x-with-Cloudera-Hbase-1-0-0-CDH-5/td-p/35505
>>
>> If anyone have any pointer let me know, Even Hbase-shaded-client does not help. 
If I removed quava reference ""com.google.guava" % "guava" % "18.0"" It will works but Elastic
search failed in that case.
>>
>> Exception in thread "main" java.lang.IllegalAccessError: tried to access method com.google.common.base.Stopwatch.<init>()V
from class org.apache.hadoop.hbase.zookeeper.MetaTableLocator
>>                at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:596)
>>                at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:580)
>>                at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:559)
>>                at org.apache.hadoop.hbase.client.ZooKeeperRegistry.getMetaRegionLocation(ZooKeeperRegistry.java:61)
>>                at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateMeta(ConnectionManager.java:1185)
>>                at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1152)
>>                at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.relocateRegion(ConnectionManager.java:1126)
>>                at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegionInMeta(ConnectionManager.java:1331)
>>                at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1155)
>>                at org.apache.hadoop.hbase.client.AsyncProcess.submit(AsyncProcess.java:370)
>>                at org.apache.hadoop.hbase.client.AsyncProcess.submit(AsyncProcess.java:321)
>>                at org.apache.hadoop.hbase.client.BufferedMutatorImpl.backgroundFlushCommits(BufferedMutatorImpl.java:206)
>>                at org.apache.hadoop.hbase.client.BufferedMutatorImpl.flush(BufferedMutatorImpl.java:183)
>>                at org.apache.hadoop.hbase.client.HTable.flushCommits(HTable.java:1425)
>>                at org.apache.hadoop.hbase.client.HTable.put(HTable.java:1018)
>>                at
>> common.TaskTracker$.updateStatus(TaskTracker.scala:55)
>>
>>
>
>
>
> --
> busbey



--
busbey
Mime
View raw message