flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Flavio Pompermaier <pomperma...@okkam.it>
Subject Re: Error with HBase and Solr job
Date Fri, 23 Dec 2016 20:12:29 GMT
What do you meab exactly...? do you have a snippet of how I should edit the
pom?

On 23 Dec 2016 19:31, "Stephan Ewen" <sewen@apache.org> wrote:

> You have the classical guava version conflict. Flink itself shades Guava
> away, but there may be multiple conflicting dependencies in your case
> (HBase / Solr).
>
> I would try to see which of the tool/libraries (HBase, Solr, ...) depend
> on Guava and create a shaded version of one of them
>
> On Fri, Dec 23, 2016 at 6:33 PM, Flavio Pompermaier <pompermaier@okkam.it>
> wrote:
>
>> Hi to all,
>>
>> I have a source HBase table and I have to write to a Solr index.
>> Unfortunately when I try to run the program on the cluster (Flink 1.1.1)
>> I think I have some problem with dependencies. Can someone suggest me some
>> fix?
>>
>> This is the error I have just after launching the job:
>>
>> Caused by: org.apache.hadoop.hbase.DoNotRetryIOException:
>> java.lang.IllegalAccessError: tried to access method
>> com.google.common.base.Stopwatch.<init>()V from class
>> org.apache.hadoop.hbase.zookeeper.MetaTableLocator
>>     at org.apache.hadoop.hbase.client.RpcRetryingCaller.translateEx
>> ception(RpcRetryingCaller.java:229)
>>     at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithout
>> Retries(RpcRetryingCaller.java:202)
>>     at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScan
>> ner.java:314)
>>     at org.apache.hadoop.hbase.client.ClientScanner.nextScanner(Cli
>> entScanner.java:289)
>>     at org.apache.hadoop.hbase.client.ClientScanner.initializeScann
>> erInConstruction(ClientScanner.java:161)
>>     at org.apache.hadoop.hbase.client.ClientScanner.<init>(ClientSc
>> anner.java:156)
>>     at org.apache.hadoop.hbase.client.HTable.getScanner(HTable.java:888)
>>     at org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScan
>> ner.java:187)
>>     at org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScan
>> ner.java:89)
>>     at org.apache.hadoop.hbase.client.MetaScanner.listTableRegionLo
>> cations(MetaScanner.java:334)
>>     at org.apache.hadoop.hbase.client.HTable.listRegionLocations(HT
>> able.java:702)
>>     at org.apache.hadoop.hbase.client.HTable.getStartEndKeys(HTable
>> .java:685)
>>     at org.apache.flink.addons.hbase.TableInputFormat.createInputSp
>> lits(TableInputFormat.java:170)
>>     at org.apache.flink.addons.hbase.TableInputFormat.createInputSp
>> lits(TableInputFormat.java:45)
>>     at org.apache.flink.runtime.executiongraph.ExecutionJobVertex.<
>> init>(ExecutionJobVertex.java:156)
>>     ... 25 more
>> Caused by: java.lang.IllegalAccessError: tried to access method
>> com.google.common.base.Stopwatch.<init>()V from class
>> org.apache.hadoop.hbase.zookeeper.MetaTableLocator
>>     at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUnti
>> lAvailable(MetaTableLocator.java:434)
>>     at org.apache.hadoop.hbase.client.ZooKeeperRegistry.getMetaRegi
>> onLocation(ZooKeeperRegistry.java:60)
>>     at org.apache.hadoop.hbase.client.ConnectionManager$HConnection
>> Implementation.locateRegion(ConnectionManager.java:1122)
>>     at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadRepl
>> icas.getRegionLocations(RpcRetryingCallerWithReadReplicas.java:299)
>>     at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.c
>> all(ScannerCallableWithReplicas.java:155)
>>     at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.c
>> all(ScannerCallableWithReplicas.java:63)
>>     at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithout
>> Retries(RpcRetryingCaller.java:200)
>>     ... 38 more
>>
>>
>> Best,
>> Flavio
>>
>
>

Mime
View raw message