Mailing-List: contact user-help@flink.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@flink.apache.org
MIME-Version: 1.0
In-Reply-To: <CAGxieHQsMsVMwVd=vB4OgPaj=U_H2puhd+se71AqY6H_No=0zw@mail.gmail.com>
References: <CAGxieHQsMsVMwVd=vB4OgPaj=U_H2puhd+se71AqY6H_No=0zw@mail.gmail.com>
From: Ufuk Celebi <uce@apache.org>
Date: Mon, 6 Jun 2016 16:12:37 +0200
Message-ID: <CAKiyyaHSwobgv0hVzExc61AULO+-ioT0xggQadWcREY72K+CVg@mail.gmail.com>
Subject: Re: Custom keyBy(), look for similaties
To: user@flink.apache.org
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
archived-at: Mon, 06 Jun 2016 14:13:19 -0000

Hey I=C3=B1aki,

you can use the KeySelector as described here:
https://ci.apache.org/projects/flink/flink-docs-release-1.0/apis/common/ind=
ex.html#specifying-keys

But you only a local view for the current element, e.g. the library
you use to determine the similarity has to know the similarities
upfront.

=E2=80=93 Ufuk


On Mon, Jun 6, 2016 at 9:31 AM, i=C3=B1aki williams <juanramallo80@gmail.co=
m> wrote:
> Hi guys,
>
> I am using Flink on my project and I have a question. (I am using Java)
>
> Is it possible to modify the keyby method in order to key by similarities
> and not by the exact name?
>
> Example: I recieve 2 DataStreams, in the first one , the name of the fiel=
d
> that I want to KeyBy is "John Locke", while in the Datastream the field
> value is "John L". Can I use some java library to find for similarities
> between strings and if the similitude is high, then key those elements
> together.