flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Flavio Pompermaier <pomperma...@okkam.it>
Subject Re: ElasticsearchSink Exception
Date Sat, 25 Feb 2017 23:09:05 GMT
The exception you have (NoClassDefFoundError:
org/elasticsearch/index/mapper/MapperParsingException) is usually caused by
elasticsearch version conflict or a bad shading when creating the uber jar.
Can you check if one of the 2 is causing the problem?

On 25 Feb 2017 23:13, "Govindarajan Srinivasaraghavan" <
govindraghvan@gmail.com> wrote:

> Hi Flavio,
>
> I tried with both http port 9200 and tcp port 9300 and I see incoming
> connections in the elasticserach node. Also I see the below errors in
> taskmanager out logs. Below are the dependencies I have on my gradle
> project. Am I missing something?
>
> Exception in thread "elasticsearch[Madame Menace][generic][T#2]"
> java.lang.NoClassDefFoundError:
> org/elasticsearch/index/mapper/MapperParsingException
>         at
> org.elasticsearch.ElasticsearchException.<clinit>(
> ElasticsearchException.java:597)
>         at
> org.elasticsearch.transport.TransportService$Adapter$3.
> run(TransportService.java:622)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.ClassNotFoundException:
> org.elasticsearch.index.mapper.MapperParsingException
>         at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>         ... 5 more
>
>
> Exception in thread "elasticsearch[Saint Elmo][generic][T#2]"
> java.lang.NoClassDefFoundError: Could not initialize class
> org.elasticsearch.transport.NodeDisconnectedException
>         at
> org.elasticsearch.transport.TransportService$Adapter$3.
> run(TransportService.java:622)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
>
>
> compile group: 'org.apache.flink', name: 'flink-core', version: '1.2.0'
> compile group: 'org.apache.flink', name: 'flink-streaming-java_2.10',
> version: '1.2.0'
> compile group: 'org.apache.flink', name: 'flink-java', version: '1.2.0'
> compile group: 'org.apache.flink', name:
> 'flink-connector-kafka-0.10_2.10', version: '1.2.0'
> compile group: 'org.apache.flink', name: 'flink-clients_2.10', version:
> '1.2.0'
>
> compile group: 'org.apache.flink', name:
> 'flink-connector-elasticsearch2_2.10', version: '1.2.0'
>
>
> On Sat, Feb 25, 2017 at 1:26 AM, Flavio Pompermaier <pompermaier@okkam.it>
> wrote:
>
> > Are you sure that in elasticsearch.yml you've enabled ES to listen to the
> > http port 9300?
> >
> > On 25 Feb 2017 08:58, "Govindarajan Srinivasaraghavan" <
> > govindraghvan@gmail.com> wrote:
> >
> > Hi All,
> >
> > I'm getting the below exception when I start my flink job. I have
> verified
> > the elastic search host and it seems to be working well. I have also
> tried
> > including the below dependecies to my project but nothing works. Need
> some
> > help. Thanks.
> >
> > compile group: 'org.apache.lucene', name: 'lucene-core', version: '5.5.0'
> > compile group: 'org.elasticsearch', name: 'elasticsearch', version:
> '2.3.5'
> >
> >
> > *Sink Code:*
> >
> > List<InetSocketAddress> transportAddresses = new ArrayList<>();
> > transportAddresses.add(new
> > InetSocketAddress(InetAddress.getByName(*hostName*), 9300));
> >
> > output.addSink(new ElasticsearchSink<>(config, transportAddresses, new
> > ElasticsearchSinkFunction<Object>() {
> >
> > }
> >
> >
> > *Exception:*
> >
> > java.lang.RuntimeException: Client is not connected to any Elasticsearch
> > nodes!
> >         at org.apache.flink.streaming.connectors.elasticsearch2.
> > ElasticsearchSink.open(ElasticsearchSink.java:172)
> >         at org.apache.flink.api.common.functions.util.FunctionUtils.
> > openFunction(FunctionUtils.java:36)
> >         at org.apache.flink.streaming.api.operators.
> > AbstractUdfStreamOperator.open(AbstractUdfStreamOperator.java:112)
> >         at org.apache.flink.streaming.runtime.tasks.StreamTask.
> > openAllOperators(StreamTask.java:386)
> >         at org.apache.flink.streaming.runtime.tasks.StreamTask.
> > invoke(StreamTask.java:262)
> >         at org.apache.flink.runtime.taskmanager.Task.run(Task.java:655)
> >         at java.lang.Thread.run(Thread.java:745)
> >
>

Mime
View raw message