Mailing-List: contact user-help@flink.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@flink.apache.org
MIME-Version: 1.0
In-Reply-To: <CANC1h_un=8pkhD=tZe78wiweviqba2yghHkDmG4-Cgat5MuQ7Q@mail.gmail.com>
References: <CAELUF_DhajjQS4PPMahG=6VUCsZc3uX2iiFPJadS_e12aM+NAw@mail.gmail.com>
 <CANC1h_un=8pkhD=tZe78wiweviqba2yghHkDmG4-Cgat5MuQ7Q@mail.gmail.com>
From: Flavio Pompermaier <pompermaier@okkam.it>
Date: Fri, 23 Dec 2016 21:12:29 +0100
Message-ID: <CAELUF_CU+-XPUAoByfSLJbn7FFuKhm6L96TR_esf=yXT5EByVA@mail.gmail.com>
Subject: Re: Error with HBase and Solr job
To: user <user@flink.apache.org>
Content-Type: multipart/alternative; boundary=001a114950dc67336a05445901fd
archived-at: Fri, 23 Dec 2016 20:12:35 -0000

--001a114950dc67336a05445901fd
Content-Type: text/plain; charset=UTF-8

What do you meab exactly...? do you have a snippet of how I should edit the
pom?

On 23 Dec 2016 19:31, "Stephan Ewen" <sewen@apache.org> wrote:

> You have the classical guava version conflict. Flink itself shades Guava
> away, but there may be multiple conflicting dependencies in your case
> (HBase / Solr).
>
> I would try to see which of the tool/libraries (HBase, Solr, ...) depend
> on Guava and create a shaded version of one of them
>
> On Fri, Dec 23, 2016 at 6:33 PM, Flavio Pompermaier <pompermaier@okkam.it>
> wrote:
>
>> Hi to all,
>>
>> I have a source HBase table and I have to write to a Solr index.
>> Unfortunately when I try to run the program on the cluster (Flink 1.1.1)
>> I think I have some problem with dependencies. Can someone suggest me some
>> fix?
>>
>> This is the error I have just after launching the job:
>>
>> Caused by: org.apache.hadoop.hbase.DoNotRetryIOException:
>> java.lang.IllegalAccessError: tried to access method
>> com.google.common.base.Stopwatch.<init>()V from class
>> org.apache.hadoop.hbase.zookeeper.MetaTableLocator
>>     at org.apache.hadoop.hbase.client.RpcRetryingCaller.translateEx
>> ception(RpcRetryingCaller.java:229)
>>     at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithout
>> Retries(RpcRetryingCaller.java:202)
>>     at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScan
>> ner.java:314)
>>     at org.apache.hadoop.hbase.client.ClientScanner.nextScanner(Cli
>> entScanner.java:289)
>>     at org.apache.hadoop.hbase.client.ClientScanner.initializeScann
>> erInConstruction(ClientScanner.java:161)
>>     at org.apache.hadoop.hbase.client.ClientScanner.<init>(ClientSc
>> anner.java:156)
>>     at org.apache.hadoop.hbase.client.HTable.getScanner(HTable.java:888)
>>     at org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScan
>> ner.java:187)
>>     at org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScan
>> ner.java:89)
>>     at org.apache.hadoop.hbase.client.MetaScanner.listTableRegionLo
>> cations(MetaScanner.java:334)
>>     at org.apache.hadoop.hbase.client.HTable.listRegionLocations(HT
>> able.java:702)
>>     at org.apache.hadoop.hbase.client.HTable.getStartEndKeys(HTable
>> .java:685)
>>     at org.apache.flink.addons.hbase.TableInputFormat.createInputSp
>> lits(TableInputFormat.java:170)
>>     at org.apache.flink.addons.hbase.TableInputFormat.createInputSp
>> lits(TableInputFormat.java:45)
>>     at org.apache.flink.runtime.executiongraph.ExecutionJobVertex.<
>> init>(ExecutionJobVertex.java:156)
>>     ... 25 more
>> Caused by: java.lang.IllegalAccessError: tried to access method
>> com.google.common.base.Stopwatch.<init>()V from class
>> org.apache.hadoop.hbase.zookeeper.MetaTableLocator
>>     at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUnti
>> lAvailable(MetaTableLocator.java:434)
>>     at org.apache.hadoop.hbase.client.ZooKeeperRegistry.getMetaRegi
>> onLocation(ZooKeeperRegistry.java:60)
>>     at org.apache.hadoop.hbase.client.ConnectionManager$HConnection
>> Implementation.locateRegion(ConnectionManager.java:1122)
>>     at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadRepl
>> icas.getRegionLocations(RpcRetryingCallerWithReadReplicas.java:299)
>>     at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.c
>> all(ScannerCallableWithReplicas.java:155)
>>     at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.c
>> all(ScannerCallableWithReplicas.java:63)
>>     at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithout
>> Retries(RpcRetryingCaller.java:200)
>>     ... 38 more
>>
>>
>> Best,
>> Flavio
>>
>
>

--001a114950dc67336a05445901fd
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"auto">What do you meab exactly...? do you have a snippet of how=
 I should edit the pom?</div><div class=3D"gmail_extra"><br><div class=3D"g=
mail_quote">On 23 Dec 2016 19:31, &quot;Stephan Ewen&quot; &lt;<a href=3D"m=
ailto:sewen@apache.org">sewen@apache.org</a>&gt; wrote:<br type=3D"attribut=
ion"><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-le=
ft:1px #ccc solid;padding-left:1ex"><div dir=3D"ltr"><div>You have the clas=
sical guava version conflict. Flink itself shades Guava away, but there may=
 be multiple conflicting dependencies in your case (HBase / Solr).<br></div=
><div><br></div><div>I would try to see which of the tool/libraries (HBase,=
 Solr, ...) depend on Guava and create a shaded version of one of them</div=
><div class=3D"gmail_extra"><br><div class=3D"gmail_quote">On Fri, Dec 23, =
2016 at 6:33 PM, Flavio Pompermaier <span dir=3D"ltr">&lt;<a href=3D"mailto=
:pompermaier@okkam.it" target=3D"_blank">pompermaier@okkam.it</a>&gt;</span=
> wrote:<br><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;bo=
rder-left:1px #ccc solid;padding-left:1ex"><div dir=3D"ltr">Hi to all,<div =
class=3D"m_-5844309157783485103m_5747251854239310512gmail_signature"><div d=
ir=3D"ltr"><div><div dir=3D"ltr"><div><div dir=3D"ltr"><p></p><p></p><p></p=
><p></p></div></div></div></div></div></div>
<div>I have a source HBase table and I have to write to a Solr index.</div>=
<div>Unfortunately when I try to run the program on the cluster (Flink 1.1.=
1) I think I have some problem with dependencies. Can someone suggest me so=
me fix?</div><div><br></div><div>This is the error I have just after launch=
ing the job:</div><div><br></div><div>Caused by: org.apache.hadoop.hbase.Do=
NotR<wbr>etryIOException: java.lang.IllegalAccessError: tried to access met=
hod com.google.common.base.Stopwat<wbr>ch.&lt;init&gt;()V from class org.ap=
ache.hadoop.hbase.zookee<wbr>per.MetaTableLocator<br>=C2=A0=C2=A0 =C2=A0at =
org.apache.hadoop.hbase.client<wbr>.RpcRetryingCaller.translateEx<wbr>cepti=
on(RpcRetryingCaller.java<wbr>:229)<br>=C2=A0=C2=A0 =C2=A0at org.apache.had=
oop.hbase.client<wbr>.RpcRetryingCaller.callWithout<wbr>Retries(RpcRetrying=
Caller.java<wbr>:202)<br>=C2=A0=C2=A0 =C2=A0at org.apache.hadoop.hbase.clie=
nt<wbr>.ClientScanner.call(ClientScan<wbr>ner.java:314)<br>=C2=A0=C2=A0 =C2=
=A0at org.apache.hadoop.hbase.client<wbr>.ClientScanner.nextScanner(Cli<wbr=
>entScanner.java:289)<br>=C2=A0=C2=A0 =C2=A0at org.apache.hadoop.hbase.clie=
nt<wbr>.ClientScanner.initializeScann<wbr>erInConstruction(ClientScanner<wb=
r>.java:161)<br>=C2=A0=C2=A0 =C2=A0at org.apache.hadoop.hbase.client<wbr>.C=
lientScanner.&lt;init&gt;(ClientSc<wbr>anner.java:156)<br>=C2=A0=C2=A0 =C2=
=A0at org.apache.hadoop.hbase.client<wbr>.HTable.getScanner(HTable.java<wbr=
>:888)<br>=C2=A0=C2=A0 =C2=A0at org.apache.hadoop.hbase.client<wbr>.MetaSca=
nner.metaScan(MetaScan<wbr>ner.java:187)<br>=C2=A0=C2=A0 =C2=A0at org.apach=
e.hadoop.hbase.client<wbr>.MetaScanner.metaScan(MetaScan<wbr>ner.java:89)<b=
r>=C2=A0=C2=A0 =C2=A0at org.apache.hadoop.hbase.client<wbr>.MetaScanner.lis=
tTableRegionLo<wbr>cations(MetaScanner.java:334)<br>=C2=A0=C2=A0 =C2=A0at o=
rg.apache.hadoop.hbase.client<wbr>.HTable.listRegionLocations(HT<wbr>able.j=
ava:702)<br>=C2=A0=C2=A0 =C2=A0at org.apache.hadoop.hbase.client<wbr>.HTabl=
e.getStartEndKeys(HTable<wbr>.java:685)<br>=C2=A0=C2=A0 =C2=A0at org.apache=
.flink.addons.hbase.<wbr>TableInputFormat.createInputSp<wbr>lits(TableInput=
Format.java:170<wbr>)<br>=C2=A0=C2=A0 =C2=A0at org.apache.flink.addons.hbas=
e.<wbr>TableInputFormat.createInputSp<wbr>lits(TableInputFormat.java:45)<br=
>=C2=A0=C2=A0 =C2=A0at org.apache.flink.runtime.execu<wbr>tiongraph.Executi=
onJobVertex.&lt;<wbr>init&gt;(ExecutionJobVertex.java:<wbr>156)<br>=C2=A0=
=C2=A0 =C2=A0... 25 more<br>Caused by: java.lang.IllegalAccessError: tried =
to access method com.google.common.base.Stopwat<wbr>ch.&lt;init&gt;()V from=
 class org.apache.hadoop.hbase.zookee<wbr>per.MetaTableLocator<br>=C2=A0=C2=
=A0 =C2=A0at org.apache.hadoop.hbase.zookee<wbr>per.MetaTableLocator.blockU=
nti<wbr>lAvailable(MetaTableLocator.ja<wbr>va:434)<br>=C2=A0=C2=A0 =C2=A0at=
 org.apache.hadoop.hbase.client<wbr>.ZooKeeperRegistry.getMetaRegi<wbr>onLo=
cation(ZooKeeperRegistry.j<wbr>ava:60)<br>=C2=A0=C2=A0 =C2=A0at org.apache.=
hadoop.hbase.client<wbr>.ConnectionManager$HConnection<wbr>Implementation.l=
ocateRegion(Co<wbr>nnectionManager.java:1122)<br>=C2=A0=C2=A0 =C2=A0at org.=
apache.hadoop.hbase.client<wbr>.RpcRetryingCallerWithReadRepl<wbr>icas.getR=
egionLocations(RpcRet<wbr>ryingCallerWithReadReplicas.ja<wbr>va:299)<br>=C2=
=A0=C2=A0 =C2=A0at org.apache.hadoop.hbase.client<wbr>.ScannerCallableWithR=
eplicas.c<wbr>all(ScannerCallableWithReplica<wbr>s.java:155)<br>=C2=A0=C2=
=A0 =C2=A0at org.apache.hadoop.hbase.client<wbr>.ScannerCallableWithReplica=
s.c<wbr>all(ScannerCallableWithReplica<wbr>s.java:63)<br>=C2=A0=C2=A0 =C2=
=A0at org.apache.hadoop.hbase.client<wbr>.RpcRetryingCaller.callWithout<wbr=
>Retries(RpcRetryingCaller.java<wbr>:200)<br>=C2=A0=C2=A0 =C2=A0... 38 more=
<br><br></div><div><br></div><div>Best,</div><div>Flavio</div></div>
</blockquote></div><br></div></div>
</blockquote></div></div>

--001a114950dc67336a05445901fd--