Mailing-List: contact commits-help@beam.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@beam.apache.org
Date: Mon, 6 Feb 2017 03:52:42 +0000 (UTC)
From: "Reza Nouri (JIRA)" <jira@apache.org>
To: commits@beam.incubator.apache.org
Message-ID: <JIRA.12986771.1467714152000.2475.1486353162425@Atlassian.JIRA>
In-Reply-To: <JIRA.12986771.1467714152000@Atlassian.JIRA>
References: <JIRA.12986771.1467714152000@Atlassian.JIRA> <JIRA.12986771.1467714152385@jira-lw-us.apache.org>
Subject: [jira] [Commented] (BEAM-425) Create Elasticsearch IO
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
archived-at: Mon, 06 Feb 2017 03:52:50 -0000


    [ https://issues.apache.org/jira/browse/BEAM-425?page=3Dcom.atlassian.j=
ira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D158534=
77#comment-15853477 ]=20

Reza Nouri commented on BEAM-425:
---------------------------------

Hi [~echauchot],

I am trying to use elasticIO, but I am getting the following error while wr=
iting data to elastic:

threw exception [org.apache.beam.sdk.Pipeline$PipelineExecutionException: o=
rg.elasticsearch.client.ResponseException: POST http://127.0.0.1:9200/named=
entities/keyword/_bulk: HTTP/1.1 400 Bad Request
{"error":{"root_cause":[{"type":"parse_exception","reason":"Failed to deriv=
e xcontent"}],"type":"parse_exception","reason":"Failed to derive xcontent"=
},"status":400}] with root cause
org.elasticsearch.client.ResponseException: POST http://127.0.0.1:9200/name=
dentities/keyword/_bulk: HTTP/1.1 400 Bad Request
{"error":{"root_cause":[{"type":"parse_exception","reason":"Failed to deriv=
e xcontent"}],"type":"parse_exception","reason":"Failed to derive xcontent"=
},"status":400}
=09at org.elasticsearch.client.RestClient$1.completed(RestClient.java:310)
=09at org.elasticsearch.client.RestClient$1.completed(RestClient.java:299)
=09at org.apache.http.concurrent.BasicFuture.completed(BasicFuture.java:119=
)
=09at org.apache.http.impl.nio.client.DefaultClientExchangeHandlerImpl.resp=
onseCompleted(DefaultClientExchangeHandlerImpl.java:177)
=09at org.apache.http.nio.protocol.HttpAsyncRequestExecutor.processResponse=
(HttpAsyncRequestExecutor.java:436)
=09at org.apache.http.nio.protocol.HttpAsyncRequestExecutor.inputReady(Http=
AsyncRequestExecutor.java:326)
=09at org.apache.http.impl.nio.DefaultNHttpClientConnection.consumeInput(De=
faultNHttpClientConnection.java:265)
=09at org.apache.http.impl.nio.client.InternalIODispatch.onInputReady(Inter=
nalIODispatch.java:81)
=09at org.apache.http.impl.nio.client.InternalIODispatch.onInputReady(Inter=
nalIODispatch.java:39)
=09at org.apache.http.impl.nio.reactor.AbstractIODispatch.inputReady(Abstra=
ctIODispatch.java:114)
=09at org.apache.http.impl.nio.reactor.BaseIOReactor.readable(BaseIOReactor=
.java:162)
=09at org.apache.http.impl.nio.reactor.AbstractIOReactor.processEvent(Abstr=
actIOReactor.java:337)
=09at org.apache.http.impl.nio.reactor.AbstractIOReactor.processEvents(Abst=
ractIOReactor.java:315)
=09at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIO=
Reactor.java:276)
=09at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.=
java:104)
=09at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.=
run(AbstractMultiworkerIOReactor.java:588)

I wrote something similar to ElasticsearchIOTest test case and the data is =
JSON format exactly same as the test file:

data.add(String.format("{\"scientist\":\"%s\", \"id\":%d}", scientists[inde=
x], i));

Also, I am using elastic 5.2 running on a single node.

Any idea?

Thanks,=20
Reza


> Create Elasticsearch IO
> -----------------------
>
>                 Key: BEAM-425
>                 URL: https://issues.apache.org/jira/browse/BEAM-425
>             Project: Beam
>          Issue Type: New Feature
>          Components: sdk-java-extensions
>            Reporter: Jean-Baptiste Onofr=C3=A9
>            Assignee: Etienne Chauchot
>             Fix For: 0.5.0
>
>
> I'm working on a new ElasticsearchIO providing both bounded source and si=
nk.


--
This message was sent by Atlassian JIRA
(v6.3.15#6346)