flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Flavio Pompermaier <pomperma...@okkam.it>
Subject Re: Error with HBase and Solr job
Date Sat, 24 Dec 2016 00:30:04 GMT
Found the problem...I compiled my flink dist using maven 3.3.9 but I didn't
rerun install from dist directory as specified at
https://ci.apache.org/projects/flink/flink-docs-release-1.1/setup/building.html#dependency-shading
.
Why is it necessary to recompile flink-dist?

Best,
Flavio

On Fri, Dec 23, 2016 at 9:24 PM, Flavio Pompermaier <pompermaier@okkam.it>
wrote:

> Ok thans Stephan!
>
> On 23 Dec 2016 21:16, "Stephan Ewen" <sewen@apache.org> wrote:
>
>> I would just google for Guava conflict and "shading". Its a fairly common
>> problem with Guava, there are quite a few guides out there how to address
>> that.
>>
>> On Fri, Dec 23, 2016 at 9:12 PM, Flavio Pompermaier <pompermaier@okkam.it
>> > wrote:
>>
>>> What do you meab exactly...? do you have a snippet of how I should edit
>>> the pom?
>>>
>>> On 23 Dec 2016 19:31, "Stephan Ewen" <sewen@apache.org> wrote:
>>>
>>>> You have the classical guava version conflict. Flink itself shades
>>>> Guava away, but there may be multiple conflicting dependencies in your case
>>>> (HBase / Solr).
>>>>
>>>> I would try to see which of the tool/libraries (HBase, Solr, ...)
>>>> depend on Guava and create a shaded version of one of them
>>>>
>>>> On Fri, Dec 23, 2016 at 6:33 PM, Flavio Pompermaier <
>>>> pompermaier@okkam.it> wrote:
>>>>
>>>>> Hi to all,
>>>>>
>>>>> I have a source HBase table and I have to write to a Solr index.
>>>>> Unfortunately when I try to run the program on the cluster (Flink
>>>>> 1.1.1) I think I have some problem with dependencies. Can someone suggest
>>>>> me some fix?
>>>>>
>>>>> This is the error I have just after launching the job:
>>>>>
>>>>> Caused by: org.apache.hadoop.hbase.DoNotRetryIOException:
>>>>> java.lang.IllegalAccessError: tried to access method
>>>>> com.google.common.base.Stopwatch.<init>()V from class
>>>>> org.apache.hadoop.hbase.zookeeper.MetaTableLocator
>>>>>     at org.apache.hadoop.hbase.client.RpcRetryingCaller.translateEx
>>>>> ception(RpcRetryingCaller.java:229)
>>>>>     at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithout
>>>>> Retries(RpcRetryingCaller.java:202)
>>>>>     at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScan
>>>>> ner.java:314)
>>>>>     at org.apache.hadoop.hbase.client.ClientScanner.nextScanner(Cli
>>>>> entScanner.java:289)
>>>>>     at org.apache.hadoop.hbase.client.ClientScanner.initializeScann
>>>>> erInConstruction(ClientScanner.java:161)
>>>>>     at org.apache.hadoop.hbase.client.ClientScanner.<init>(ClientSc
>>>>> anner.java:156)
>>>>>     at org.apache.hadoop.hbase.client.HTable.getScanner(HTable.java
>>>>> :888)
>>>>>     at org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScan
>>>>> ner.java:187)
>>>>>     at org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScan
>>>>> ner.java:89)
>>>>>     at org.apache.hadoop.hbase.client.MetaScanner.listTableRegionLo
>>>>> cations(MetaScanner.java:334)
>>>>>     at org.apache.hadoop.hbase.client.HTable.listRegionLocations(HT
>>>>> able.java:702)
>>>>>     at org.apache.hadoop.hbase.client.HTable.getStartEndKeys(HTable
>>>>> .java:685)
>>>>>     at org.apache.flink.addons.hbase.TableInputFormat.createInputSp
>>>>> lits(TableInputFormat.java:170)
>>>>>     at org.apache.flink.addons.hbase.TableInputFormat.createInputSp
>>>>> lits(TableInputFormat.java:45)
>>>>>     at org.apache.flink.runtime.executiongraph.ExecutionJobVertex.<
>>>>> init>(ExecutionJobVertex.java:156)
>>>>>     ... 25 more
>>>>> Caused by: java.lang.IllegalAccessError: tried to access method
>>>>> com.google.common.base.Stopwatch.<init>()V from class
>>>>> org.apache.hadoop.hbase.zookeeper.MetaTableLocator
>>>>>     at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUnti
>>>>> lAvailable(MetaTableLocator.java:434)
>>>>>     at org.apache.hadoop.hbase.client.ZooKeeperRegistry.getMetaRegi
>>>>> onLocation(ZooKeeperRegistry.java:60)
>>>>>     at org.apache.hadoop.hbase.client.ConnectionManager$HConnection
>>>>> Implementation.locateRegion(ConnectionManager.java:1122)
>>>>>     at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadRepl
>>>>> icas.getRegionLocations(RpcRetryingCallerWithReadReplicas.java:299)
>>>>>     at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.c
>>>>> all(ScannerCallableWithReplicas.java:155)
>>>>>     at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.c
>>>>> all(ScannerCallableWithReplicas.java:63)
>>>>>     at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithout
>>>>> Retries(RpcRetryingCaller.java:200)
>>>>>     ... 38 more
>>>>>
>>>>>
>>>>> Best,
>>>>> Flavio
>>>>>
>>>>
>>>>
>>


-- 

Flavio Pompermaier

*Development Department*_______________________________________________
*OKKAM**Srl **- www.okkam.it <http://www.okkam.it/>*

*Phone:* +(39) 0461 1823908
*Fax:* + (39) 0461 186 6433
*Email:* pompermaier@okkam.it
*Headquarters:* Trento (Italy), via G.B. Trener 8
*Registered office:* Trento (Italy), via Segantini 23

Confidentially notice. This e-mail transmission may contain legally
privileged and/or confidential information. Please do not read it if you
are not the intended recipient(S). Any use, distribution, reproduction or
disclosure by any other person is strictly prohibited. If you have received
this e-mail in error, please notify the sender and destroy the original
transmission and its attachments without reading or saving it in any manner.

Mime
View raw message