camel-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From slush <derek.abd...@gmail.com>
Subject Elasticsearch component - bulk requests with ids
Date Wed, 10 Dec 2014 21:49:33 GMT
Hello! I'm new to the camel forums. First off, thank you to all the
contributors. Camel is a wonderful framework.

While doing some work recently I came across an issue with the elasticsearch
component. Specifically, I need to be able to send a bulk request where the
documents in the bulk request have application-provided (not
automatically-generated, as is what happens by default with the
elasticsearch-java client) document ids.

I see that the INDEX operation supports an index header as of version 2.15.0
(which is yet to be released). However, this still wouldn't satisfy my need,
as I want to send bulk updates, not individual index requests for
speed/efficiency.

So, I've temporarily forked the elasticsearch component and added support
for my use case and others. To do this, 

My question is whether this is a suitable change to the component. If so,
I'll attempt to create a ticket in the issue tracker and a pull request for
the changes I've made after I'm done finalizing them (I haven't read through
the contribution guide yet, i'm sure I need tests, doc, coding standards,
etc.).

Additionally, is it common for components to provide other helper classes,
like AggregationStrategies? I've written an aggregation strategy that will
collect individual IndexRequests into a BulkRequest so that the change I've
made in the Elasticsearch component can support my needs. This is easily
reproducible by others and follows after the ArrayListAggregationStrategy
example in the camel guide, but I think the use case would be common so it
may be good to include with the patch as well.

Thank you!
Derek Abdine



--
View this message in context: http://camel.465427.n5.nabble.com/Elasticsearch-component-bulk-requests-with-ids-tp5760522.html
Sent from the Camel - Users mailing list archive at Nabble.com.

Mime
View raw message