Mailing-List: contact user-help@flume.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@flume.apache.org
MIME-Version: 1.0
From: Jeff Lord <jlord@cloudera.com>
Date: Tue, 11 Jul 2017 07:01:47 -0700
Message-ID: <CAJmzdXkKarBYp0h3Y_C=t5mKcwnVuq=omnUc-np7Ge7f=o387A@mail.gmail.com>
Subject: unsubscribe
To: "user@flume.apache.org" <user@flume.apache.org>
Content-Type: multipart/alternative; boundary="f403045f01e6f0ce3605540b237c"
archived-at: Tue, 11 Jul 2017 14:01:57 -0000

--f403045f01e6f0ce3605540b237c
Content-Type: text/plain; charset="UTF-8"

unsubscribe

On Tue, Jun 27, 2017 at 9:24 AM, <tj5527@tutanota.com> wrote:

> I am integrating flume (v 1.7) with solr morphline sinks. Solr version is
> 6.6.0. But when starting up flume
>
>     flume-ng agent --conf conf/ --conf-file conf/agent.conf --name a1
> -Dflume.root.logger=INFO,console > logs/flume.log
>
> The log file throws NoClassDefFoundError
>
>     java.lang.NoClassDefFoundError: org/apache/solr/client/solrj/
> SolrServer
>         at org.kitesdk.morphline.solr.LoadSolrBuilder$LoadSolr.<
> init>(LoadSolrBuilder.java:85)
>         at org.kitesdk.morphline.solr.LoadSolrBuilder.build(
> LoadSolrBuilder.java:67)
>         at org.kitesdk.morphline.base.AbstractCommand.buildCommand(
> AbstractCommand.java:302)
>         at org.kitesdk.morphline.base.AbstractCommand.buildCommandChain(
> AbstractCommand.java:249)
>         at org.kitesdk.morphline.stdlib.Pipe.<init>(Pipe.java:46)
>         at org.kitesdk.morphline.stdlib.PipeBuilder.build(PipeBuilder.
> java:40)
>         at org.kitesdk.morphline.base.Compiler.compile(Compiler.java:126)
>         at org.kitesdk.morphline.base.Compiler.compile(Compiler.java:55)
>         at org.apache.flume.sink.solr.morphline.MorphlineHandlerImpl.
> configure(MorphlineHandlerImpl.java:12)
>         at org.apache.flume.sink.solr.morphline.MorphlineSink.start(
> MorphlineSink.java:98)
>         at org.apache.flume.sink.DefaultSinkProcessor.start(
> DefaultSinkProcessor.java:45)
>         at org.apache.flume.SinkRunner.start(SinkRunner.java:79)
>
> But I am sure solr-solrj-6.6.0.jar existed in lib folder
>
>     -rw-rw-r-- 1 jason jason 1.2M Jun 27 15:53 lib/solr-solrj-6.6.0.jar
>
> How can I fix this problem?
>
> Thanks.
>
> My morphline conf looks like
>
> solrLocator: {
>   collection : collection1
>   zkHost : "127.0.0.1:2181"
> }
>
> morphlines : [
>   {
>
>     id : morphline1
>     importCommands : ["org.kitesdk.**", "org.apache.solr.**"]
>
>     commands : [
>       { readJson { } }
>       { generateUUID { field : id } }
>       { loadSolr: { solrLocator : ${solrLocator} } }
>     ]
>   }
> ]
>
> And flume agent conf containing morphline sink (other parts of conf e.g.
> sources are correctly configured as it works with different sources and
> sink such as kafka and s3)
>
> a1.sinks.k1.type = org.apache.flume.sink.solr.morphline.MorphlineSolrSink
> a1.sinks.k1.channel = c2
> a1.sinks.k1.morphlineFile =/path/to/conf/morphline.conf
> a1.sinks.k1.morphlineId = morphline1
>

--f403045f01e6f0ce3605540b237c
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">unsubscribe<div class=3D"gmail_extra"><br><div class=3D"gm=
ail_quote">On Tue, Jun 27, 2017 at 9:24 AM,  <span dir=3D"ltr">&lt;<a href=
=3D"mailto:tj5527@tutanota.com" target=3D"_blank">tj5527@tutanota.com</a>&g=
t;</span> wrote:<br><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0=
 .8ex;border-left:1px #ccc solid;padding-left:1ex">
 =20
   =20
 =20
  <div>
I am integrating flume (v 1.7) with solr morphline sinks. Solr version is 6=
.6.0. But when starting up flume=C2=A0<div><br></div><div>=C2=A0 =C2=A0 flu=
me-ng agent --conf conf/ --conf-file conf/agent.conf --name a1 -Dflume.root=
.logger=3DINFO,<wbr>console &gt; logs/flume.log=C2=A0<br></div><div><br></d=
iv><div>The log file throws NoClassDefFoundError</div><div><br></div><div>=
=C2=A0 =C2=A0 java.lang.<wbr>NoClassDefFoundError: org/apache/solr/client/s=
olrj/<wbr>SolrServer=C2=A0</div><div><div>=C2=A0 =C2=A0 =C2=A0 =C2=A0 at or=
g.kitesdk.morphline.solr.<wbr>LoadSolrBuilder$LoadSolr.&lt;<wbr>init&gt;(Lo=
adSolrBuilder.java:85)</div><div>=C2=A0 =C2=A0 =C2=A0 =C2=A0 at org.kitesdk=
.morphline.solr.<wbr>LoadSolrBuilder.build(<wbr>LoadSolrBuilder.java:67)</d=
iv><div>=C2=A0 =C2=A0 =C2=A0 =C2=A0 at org.kitesdk.morphline.base.<wbr>Abst=
ractCommand.buildCommand(<wbr>AbstractCommand.java:302)</div><div>=C2=A0 =
=C2=A0 =C2=A0 =C2=A0 at org.kitesdk.morphline.base.<wbr>AbstractCommand.<wb=
r>buildCommandChain(<wbr>AbstractCommand.java:249)</div><div>=C2=A0 =C2=A0 =
=C2=A0 =C2=A0 at org.kitesdk.morphline.stdlib.<wbr>Pipe.&lt;init&gt;(Pipe.j=
ava:46)</div><div>=C2=A0 =C2=A0 =C2=A0 =C2=A0 at org.kitesdk.morphline.stdl=
ib.<wbr>PipeBuilder.build(PipeBuilder.<wbr>java:40)</div><div>=C2=A0 =C2=A0=
 =C2=A0 =C2=A0 at org.kitesdk.morphline.base.<wbr>Compiler.compile(Compiler=
.<wbr>java:126)</div><div>=C2=A0 =C2=A0 =C2=A0 =C2=A0 at org.kitesdk.morphl=
ine.base.<wbr>Compiler.compile(Compiler.<wbr>java:55)</div><div>=C2=A0 =C2=
=A0 =C2=A0 =C2=A0 at org.apache.flume.sink.solr.<wbr>morphline.<wbr>Morphli=
neHandlerImpl.<wbr>configure(<wbr>MorphlineHandlerImpl.java:12)</div><div>=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 at org.apache.flume.sink.solr.<wbr>morphline.Mo=
rphlineSink.start(<wbr>MorphlineSink.java:98)</div><div>=C2=A0 =C2=A0 =C2=
=A0 =C2=A0 at org.apache.flume.sink.<wbr>DefaultSinkProcessor.start(<wbr>De=
faultSinkProcessor.java:45)</div><div>=C2=A0 =C2=A0 =C2=A0 =C2=A0 at org.ap=
ache.flume.SinkRunner.<wbr>start(SinkRunner.java:79)</div></div><div><br></=
div><div>But I am sure solr-solrj-6.6.0.jar existed in lib folder<br></div>=
<div><br></div><div>=C2=A0 =C2=A0 -rw-rw-r-- 1 jason jason 1.2M Jun 27 15:5=
3 lib/solr-solrj-6.6.0.jar<br></div><div><br></div><div>How can I fix this =
problem?=C2=A0<br></div><div><br></div><div>Thanks.=C2=A0</div><div><br></d=
iv><div><div>My morphline conf looks like=C2=A0</div><div><br></div><div><d=
iv>solrLocator: {</div><div>=C2=A0 collection : collection1</div><div>=C2=
=A0 zkHost : &quot;<a href=3D"http://127.0.0.1:2181" target=3D"_blank">127.=
0.0.1:2181</a>&quot;</div><div>}</div><div><br></div><div>morphlines : [</d=
iv><div>=C2=A0 {</div><div><br></div><div>=C2=A0 =C2=A0 id : morphline1</di=
v><div>=C2=A0 =C2=A0 importCommands : [&quot;org.kitesdk.**&quot;, &quot;or=
g.apache.solr.**&quot;]</div><div><br></div><div>=C2=A0 =C2=A0 commands : [=
</div><div>=C2=A0 =C2=A0 =C2=A0 { readJson { } }</div><div>=C2=A0 =C2=A0 =
=C2=A0 { generateUUID { field : id } }</div><div>=C2=A0 =C2=A0 =C2=A0 { loa=
dSolr: { solrLocator : ${solrLocator} } }</div><div>=C2=A0 =C2=A0 ]</div><d=
iv>=C2=A0 }</div><div>]</div></div><div><br></div><div>And flume agent conf=
 containing morphline sink (other parts of conf e.g. sources are correctly =
configured as it works with different sources and sink such as kafka and s3=
)</div><div><br></div><div>a1.sinks.k1.type =3D org.apache.flume.sink.solr.=
<wbr>morphline.MorphlineSolrSink<br></div><div><div>a1.sinks.k1.channel =3D=
 c2</div><div>a1.sinks.k1.morphlineFile =3D/path/to/conf/morphline.conf</di=
v><div>a1.sinks.k1.morphlineId =3D morphline1</div></div></div>  </div>

</blockquote></div><br></div></div>

--f403045f01e6f0ce3605540b237c--