hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sean Busbey <bus...@cloudera.com>
Subject Re: Hbase Es -Quava lib conflict
Date Thu, 21 Jul 2016 21:57:02 GMT
that's part of our mapreduce support. for it, you currently need to
use the hbase-shaded-server artifact.

On Thu, Jul 21, 2016 at 1:23 PM, Saurabh Malviya (samalviy)
<samalviy@cisco.com> wrote:
> With Shaded client it is not able to find  below class
>
> import org.apache.hadoop.hbase.mapred.TableOutputFormat
>
>
> -----Original Message-----
> From: Sean Busbey [mailto:busbey@cloudera.com]
> Sent: Wednesday, July 20, 2016 12:00 PM
> To: user <user@hbase.apache.org>
> Subject: Re: Hbase Es -Quava lib conflict
>
> why do you have a dependency on o.a.hbase:hbase, o.a.hbase:hbase-server, and o.a.hbase:hbase-common?
If you have those, then the shaded client won't do you any good. You should only need the
hbase-shaded-client artifact.
>
> There hasn't been a CDH release with a functioning shaded client yet.
> AFAIK, the first ones will be 1.2.0-cdh5.7.2 and 1.2.0-cdh5.8.0. What version is the
cluster you are trying to work with?
>
> On Wed, Jul 20, 2016 at 1:15 PM, Saurabh Malviya (samalviy) <samalviy@cisco.com>
wrote:
>> This is my sbt looks like
>>
>> val hbaseVersion = "1.0.0-cdh5.5.0"
>>
>>   "org.apache.hbase" % "hbase" % hbaseVersion,
>>   "org.apache.hbase" % "hbase-server" % hbaseVersion,
>>   "org.apache.hbase" % "hbase-client" % hbaseVersion, -- > Used shaded client
as well not working (Used all version upto 1.2.1)
>>   "org.apache.hbase" % "hbase-common" % hbaseVersion,
>>   "org.elasticsearch" % "elasticsearch-hadoop" % "5.0.0-alpha4" % "compile",
>>   "org.elasticsearch" % "elasticsearch" % "2.3.3",
>>   "com.google.guava" % "guava" % "18.0" --> This is the culprit -IF I remove this
elastic search will not work.
>>
>>
>> -----Original Message-----
>> From: Sean Busbey [mailto:busbey@cloudera.com]
>> Sent: Wednesday, July 20, 2016 10:25 AM
>> To: user <user@hbase.apache.org>
>> Subject: Re: Hbase Es -Quava lib conflict
>>
>> how are you making use of hbase shaded client? that module should remove this issue
entirely.
>>
>> On Tue, Jul 19, 2016 at 5:50 PM, Saurabh Malviya (samalviy) <samalviy@cisco.com>
wrote:
>>> Hi,
>>>
>>> I am addressing one issue to make Hbase and ES work together in same
>>> spark project
>>>
>>> https://community.cloudera.com/t5/Storage-Random-Access-HDFS/Apache-H
>>> B
>>> ase-Shaded-Client-1-1-x-with-Cloudera-Hbase-1-0-0-CDH-5/td-p/35505
>>>
>>> If anyone have any pointer let me know, Even Hbase-shaded-client does not help.
 If I removed quava reference ""com.google.guava" % "guava" % "18.0"" It will works but Elastic
search failed in that case.
>>>
>>> Exception in thread "main" java.lang.IllegalAccessError: tried to access method
com.google.common.base.Stopwatch.<init>()V from class org.apache.hadoop.hbase.zookeeper.MetaTableLocator
>>>                at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:596)
>>>                at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:580)
>>>                at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:559)
>>>                at org.apache.hadoop.hbase.client.ZooKeeperRegistry.getMetaRegionLocation(ZooKeeperRegistry.java:61)
>>>                at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateMeta(ConnectionManager.java:1185)
>>>                at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1152)
>>>                at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.relocateRegion(ConnectionManager.java:1126)
>>>                at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegionInMeta(ConnectionManager.java:1331)
>>>                at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1155)
>>>                at org.apache.hadoop.hbase.client.AsyncProcess.submit(AsyncProcess.java:370)
>>>                at org.apache.hadoop.hbase.client.AsyncProcess.submit(AsyncProcess.java:321)
>>>                at org.apache.hadoop.hbase.client.BufferedMutatorImpl.backgroundFlushCommits(BufferedMutatorImpl.java:206)
>>>                at org.apache.hadoop.hbase.client.BufferedMutatorImpl.flush(BufferedMutatorImpl.java:183)
>>>                at org.apache.hadoop.hbase.client.HTable.flushCommits(HTable.java:1425)
>>>                at org.apache.hadoop.hbase.client.HTable.put(HTable.java:1018)
>>>                at
>>> common.TaskTracker$.updateStatus(TaskTracker.scala:55)
>>>
>>>
>>
>>
>>
>> --
>> busbey
>
>
>
> --
> busbey



-- 
busbey

Mime
View raw message