Mailing-List: contact dev-help@apex.incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@apex.incubator.apache.org
MIME-Version: 1.0
In-Reply-To: 
 <CAMqituOeibxWpDAzwrgr1Ocu35d9ZA=1W7AzzN8hdFN0NR1tiQ@mail.gmail.com>
References: 
 <CAKaBFBkKDXVCh+h2mhFZ+D93m+8aVhdgdxEirsKtqcsFHT0axw@mail.gmail.com>
	<CAMqituOeibxWpDAzwrgr1Ocu35d9ZA=1W7AzzN8hdFN0NR1tiQ@mail.gmail.com>
Date: Wed, 9 Dec 2015 00:12:51 -0800
Message-ID: 
 <CAKaBFBnYTeo4J0rY7Kdk_zm=p9c9LvRF7uuo0bZqYE+TNsdDBw@mail.gmail.com>
Subject: Re: BloomFilter in Malhar
From: Chandni Singh <chandni@datatorrent.com>
To: dev@apex.incubator.apache.org
Content-Type: multipart/alternative; boundary=089e013d1a5e1a32b8052672a810

--089e013d1a5e1a32b8052672a810
Content-Type: text/plain; charset=UTF-8

Chaitanya,

I believe you have an implementation of BloomFilter in your folk. Do you
think that can be added to Malhar?

Chandni

On Tue, Dec 8, 2015 at 9:02 PM, David Yan <david@datatorrent.com> wrote:

> Bloom Filter, MinHash, and HyperLogLog are some of the commonly used
> algorithms in Big Data.  I think having them in the Malhar library would be
> a good idea.
>
> There's a ticket for HyperLogLog created long time ago:
> https://malhar.atlassian.net/browse/MLHR-1822
>
> On Tue, Dec 8, 2015 at 5:42 PM, Chandni Singh <chandni@datatorrent.com>
> wrote:
>
> > Hi,
> >
> > We need to add a BloomFilter implementation in Malhar. ManagedState has a
> > use for it and I am pretty sure we will come up more and more use cases
> > that will need it. Tim's suggestion on Spill-able/Spooled data structures
> > may use it too.
> >
> > Chandni
> >
>

--089e013d1a5e1a32b8052672a810--