flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mike Percy <mpe...@apache.org>
Subject Re: [NEW FEATURE] - FLUME-1687 - Solr Sink for Apache Flume Now In Beta
Date Mon, 22 Apr 2013 08:11:42 GMT
Israel,
Nice! I'll find some time to dig into your patch this week.

Regards,
Mike



On Sat, Apr 20, 2013 at 10:43 AM, Israel Ekpo <israel@aicer.org> wrote:

> Fellow Flume Users,
>
> I have just created an Apache Solr sink for Flume against version 1.3.1
>
> This has been tested and it works fine.
>
> This sink is a great alternative to the ElasticSearchSink.
>
> There are some flume users that have experience with Apache Solr but do not
> necessarily understand how to get ElasticSearch up and running.
>
> Having a SolrSink as an alternative could be very helpful in creating a
> user interface for searching through event and log data collected with
> Flume using Apache Solr.
>
> This sink essentially picks up events from the channel and uses the
> ConcurrentUpdateSolrServer client from SolrJ to send events in batches as
> SolrInputDocuments using multipe worker threads to Apache Solr.
>
> The number of documents/events per batch and the number of worker threads
> can be configured.
>
> There is a default serializer as well.
>
> If you have the chance please try it out and let me know what you think.
>
> It would be great to gather some feedback from users before finalizing the
> features and configuration options for this sink.
>
> Instructions are available here on how to set up and configure this sink.
>
>
> https://cwiki.apache.org/confluence/display/FLUME/How+to+Setup+Solr+Sink+for+Flume
>
> JAR files for the feature as well as its dependencies are available here
>
> https://issues.apache.org/jira/browse/FLUME-1687
>

Mime
View raw message