Mailing-List: contact dev-help@accumulo.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@accumulo.apache.org
Received-SPF: pass (nike.apache.org: domain of hshreedharan@cloudera.com
 designates 209.85.160.41 as permitted sender)
Date: Thu, 18 Jul 2013 11:21:28 -0700
From: Hari Shreedharan <hshreedharan@cloudera.com>
To: dev@accumulo.apache.org
Message-ID: <02725F1F7F444800A69B368FAB97499B@cloudera.com>
In-Reply-To: 
 <CAGHyZ6LZxHon8002rwtyGbiYRta_=6vuHDuVUMBCj6izGYtd8w@mail.gmail.com>
References: 
 <CALmiJTQw91ZSWWfgcjxVoZ9-8yN_50MuCU3kBYRRT_bXYmLKMw@mail.gmail.com>
 <CAGHyZ6LRsKGcOGgvP-kfev-LNaD0U9yLob9X_J8tRj7n+1y11Q@mail.gmail.com>
 <6312D1E9-22AC-49BF-8661-13B6F3608DEF@clearedgeit.com>
 <CAGHyZ6LZxHon8002rwtyGbiYRta_=6vuHDuVUMBCj6izGYtd8w@mail.gmail.com>
Subject: Re: Accumulo flume sink
MIME-Version: 1.0
Content-Type: multipart/alternative; boundary="51e83228_100f8fca_21f3"

--51e83228_100f8fca_21f3
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

Hi Don,

I'd be glad to review and commit this to the Apache Flume project alongside the HBase sink, if you choose to consider Flume as an option. There have been sinks writing to many systems (like HBase, ElasticSearch, Solr etc) committed to Flume and an Accumulo Sink would be welcome!


Thanks,
Hari


Thanks,
Hari


On Thursday, July 18, 2013 at 11:16 AM, Sean Busbey wrote:

> In general, I think it's a good idea to push things into the external
> projects. Granted, this depends on the mindset of various communities.
> 
> 
> On Thu, Jul 18, 2013 at 1:08 PM, Donald Miner <dminer@clearedgeit.com (mailto:dminer@clearedgeit.com)>wrote:
> 
> > Should we try to do this for other things like the pig storage mechanisms?
> > Has anyone else tried getting accumulo specific stuff into the tools?
> > 
> > On Jul 18, 2013, at 1:46 PM, Sean Busbey <busbey@cloudera.com (mailto:busbey@cloudera.com)> wrote:
> > 
> > > Hi Matt!
> > > 
> > > How about contributing the sink to Flume directly? As Jon mentioned, the
> > > Accumulo API is pretty stable, and they're generally receptive to new
> > > 
> > 
> > sinks
> > > (there's also an existing HBase sink).
> > > 
> > > 
> > > On Mon, Jul 15, 2013 at 1:03 PM, Matthew Molek <mmolek@clearedgeit.com (mailto:mmolek@clearedgeit.com)
> > > wrote:
> > > 
> > > > The idea of a writing flume sink for accumulo was suggested last year in
> > > > ACCUMULO-811, but I don't think any activity ever came of it.
> > > > 
> > > > https://issues.apache.org/jira/browse/ACCUMULO-811
> > > > 
> > > > I've rewritten the original code (which wasn't on the Jira, but I got a
> > > > copy of) to mirror the way the flume sink for hbase is organized, and to
> > > > work with flume-ng.
> > > > 
> > > > My code is up on github:
> > https://github.com/mpmolek/flume-ng-accumulo-sink
> > > > 
> > > > I'd welcome any comments, and if there is interest, I'd be happy to have
> > > > this added to contrib.
> > > > 
> > > > -Matt
> > > > 
> > > > --
> > > > This communication is the property of ClearEdge IT Solutions, LLC and
> > > > 
> > > 
> > 
> > may
> > > > contain confidential and/or privileged information. Any review,
> > > > retransmissions, dissemination or other use of or taking of any action
> > > > 
> > > 
> > 
> > in
> > > > reliance upon this information by persons or entities other than the
> > > > intended recipient is prohibited. If you receive this communication in
> > > > error, please immediately notify the sender and destroy all copies of
> > > > 
> > > 
> > 
> > the
> > > > communication and any attachments.
> > > 
> > > 
> > > 
> > > 
> > > --
> > > Sean Busbey
> > > Senior Solutions Architect
> > > Cloudera, Inc.
> > > Phone: MAN-VS-BEARD
> > > 
> > 
> > 
> > --
> > This communication is the property of ClearEdge IT Solutions, LLC and may
> > contain confidential and/or privileged information. Any review,
> > retransmissions, dissemination or other use of or taking of any action in
> > reliance upon this information by persons or entities other than the
> > intended recipient is prohibited. If you receive this communication in
> > error, please immediately notify the sender and destroy all copies of the
> > communication and any attachments.
> > 
> 
> 
> 
> 
> -- 
> Sean Busbey
> Senior Solutions Architect
> Cloudera, Inc.
> Phone: MAN-VS-BEARD
> 
> 


--51e83228_100f8fca_21f3--