Mailing-List: contact user-help@flink.apache.org; run by ezmlm
Precedence: bulk
From: Gwenhael Pasquiers <gwenhael.pasquiers@ericsson.com>
To: Derek VerLee <derekverlee@gmail.com>, "user@flink.apache.org"
	<user@flink.apache.org>
Subject: RE: Streaming : a way to "key by partition id" without redispatching
 data
Thread-Topic: Streaming : a way to "key by partition id" without redispatching
 data
Thread-Index: AdNZeydoYjgKYFP9TAqEWvyUlh0E5AAlTXwwAAkV8QAABBVFEAAAaXCAAIY0gAA=
Date: Mon, 13 Nov 2017 09:18:45 +0000
Message-ID: <VI1PR07MB3357ACB169C59559EC6A1599F72B0@VI1PR07MB3357.eurprd07.prod.outlook.com>
References: <VI1PR07MB33576337FB5A44477E19F7F8F7570@VI1PR07MB3357.eurprd07.prod.outlook.com>
 <VI1PR07MB3357D1D52CC43CF3CDB84FA2F7540@VI1PR07MB3357.eurprd07.prod.outlook.com>
 <VI1PR07MB3357A05760D908634C40AE23F7540@VI1PR07MB3357.eurprd07.prod.outlook.com>
 <VI1PR07MB3357F72FC713FEFAED9A0B72F7540@VI1PR07MB3357.eurprd07.prod.outlook.com>
 <178e661f-1a63-bb69-8378-74612241b20e@gmail.com>
In-Reply-To: <178e661f-1a63-bb69-8378-74612241b20e@gmail.com>
Accept-Language: fr-FR, en-US
Content-Language: en-US
received-spf: None (protection.outlook.com: ericsson.com does not designate
 permitted sender hosts)
spamdiagnosticoutput: 1:99
spamdiagnosticmetadata: NSPM
Content-Type: multipart/alternative;
	boundary="_000_VI1PR07MB3357ACB169C59559EC6A1599F72B0VI1PR07MB3357eurp_"
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-Network-Message-Id: a246528b-d8cf-4ecb-0b5d-08d52a778a43
X-MS-Exchange-CrossTenant-originalarrivaltime: 13 Nov 2017 09:18:45.0511
 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 92e84ceb-fbfd-47ab-be52-080c6b87953f
X-MS-Exchange-Transport-CrossTenantHeadersStamped: VI1PR07MB3360
X-OriginatorOrg: ericsson.com
X-Brightmail-Tracker: H4sIAAAAAAAAA02Sa0iTYRiGefcdtomLz+XyyTRqUJDnLGiZSgaRUEp0ANGipn6p6XRsSzL6
	sbQf6so8oLBlOMksVEjWTC0P2yycZzGdsbLAaWYWZVhaiuV8J/jveu77fl64H14eIWygvHlp
	mSpWkSnNENNupDauOSQwO4kfHzLUGCiZ6KugJfce2YijnOh262MU3aqb4J7mxLuFJ7MZadms
	IjjysluqdrCYK38ovm4yldFqVLCzEPF5wByE23UGshC58YRMFwL131kKD1YEek057RxI5i4B
	X54tuWIVHLBY7TQeHAjs7+qR8zGaCYOVyTfr7MkkwPidcdrJW5lzoO9qprF+Hp4vzHAxx0Lb
	HM6TzB7o/l3McbKAuQDWhqV1FjL5BDxYznAyn4mAQqOZcjJifMFWXU86mWC8wD5VxcGFGKhp
	GyIwi2DWserKJ8Jk0SjC+i4oMH115X1hpEqDnGWAsXCh9kUZjY0gaCr55lqIAbWmgMYhLYK+
	VbVr2w/aKw0U5nSYNi679DDIL+mm8MIoBTP9MyQ2fMBhK+Fiw0HBv54WuhgF6DbVwJwFlQOf
	Kd36OTygRztFYj0A9C9/0pj9obZ6jtjgfpODs1nXI24dEilZZaIsJTQ0iFWkJSmVWZlBmazK
	gNb+kNm4HNKCZmeiLIjhIbG7QH+KHy+kpNnKHJkFAY8QewpyT65JgmRpzg1WkXVJcS2DVVrQ
	Dh4p9hJEdQzHCZkUqYpNZ1k5q9hwOTy+txrdlC/69+71uU+Hug9viznyykP2tryz41Zs16Ds
	aV5ZrrZhdz7n2Heh7vhZuST+RF5Nk8GmOmCejzNE/1qwi4JNzZPGxPbIxYgBcVG06NN01tUR
	wZaP4WWl2u2trw/1SlbCkls+NJrNhxcuavbNn3k/P/Yk6EqXlfghKf0zFtHZnCAmlanS/X6E
	Qin9D4dF1B0/AwAA
archived-at: Mon, 13 Nov 2017 09:19:08 -0000

--_000_VI1PR07MB3357ACB169C59559EC6A1599F72B0VI1PR07MB3357eurp_
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

From what I understood, in your case you might solve your issue by using sp=
ecific key classes instead of Strings.

Maybe you could create key classes that have a user-specified hashcode that=
 could take the previous key's hashcode as a value. That way your data shou=
ldn't be sent over the wire and stay in the same partition thus on the same=
 taskmanager..

--_000_VI1PR07MB3357ACB169C59559EC6A1599F72B0VI1PR07MB3357eurp_
Content-Type: text/html; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

<html xmlns:v=3D"urn:schemas-microsoft-com:vml" xmlns:o=3D"urn:schemas-micr=
osoft-com:office:office" xmlns:w=3D"urn:schemas-microsoft-com:office:word" =
xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" xmlns=3D"http:=
//www.w3.org/TR/REC-html40">
<head>
<meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dus-ascii"=
>
<meta name=3D"Generator" content=3D"Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
	{font-family:"Cambria Math";
	panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
	{font-family:Calibri;
	panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
	{margin:0cm;
	margin-bottom:.0001pt;
	font-size:11.0pt;
	font-family:"Calibri",sans-serif;
	color:black;
	mso-fareast-language:EN-US;}
a:link, span.MsoHyperlink
	{mso-style-priority:99;
	color:#0563C1;
	text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
	{mso-style-priority:99;
	color:#954F72;
	text-decoration:underline;}
p
	{mso-style-priority:99;
	mso-margin-top-alt:auto;
	margin-right:0cm;
	mso-margin-bottom-alt:auto;
	margin-left:0cm;
	font-size:11.0pt;
	font-family:"Calibri",sans-serif;
	color:black;
	mso-fareast-language:EN-US;}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
	{mso-style-priority:34;
	margin-top:0cm;
	margin-right:0cm;
	margin-bottom:0cm;
	margin-left:36.0pt;
	margin-bottom:.0001pt;
	font-size:11.0pt;
	font-family:"Calibri",sans-serif;
	color:black;
	mso-fareast-language:EN-US;}
p.msonormal0, li.msonormal0, div.msonormal0
	{mso-style-name:msonormal;
	mso-style-priority:99;
	mso-margin-top-alt:auto;
	margin-right:0cm;
	mso-margin-bottom-alt:auto;
	margin-left:0cm;
	font-size:12.0pt;
	font-family:"Times New Roman",serif;
	color:black;
	mso-fareast-language:FR;}
span.EmailStyle20
	{mso-style-type:personal;
	font-family:"Calibri",sans-serif;
	color:windowtext;}
span.EmailStyle21
	{mso-style-type:personal;
	font-family:"Calibri",sans-serif;
	color:windowtext;}
span.EmailStyle22
	{mso-style-type:personal;
	font-family:"Calibri",sans-serif;
	color:windowtext;}
span.EmailStyle23
	{mso-style-type:personal;
	font-family:"Calibri",sans-serif;
	color:windowtext;}
span.EmailStyle24
	{mso-style-type:personal-reply;
	font-family:"Calibri",sans-serif;
	color:windowtext;}
.MsoChpDefault
	{mso-style-type:export-only;
	font-size:10.0pt;}
@page WordSection1
	{size:612.0pt 792.0pt;
	margin:70.85pt 70.85pt 70.85pt 70.85pt;}
div.WordSection1
	{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext=3D"edit">
<o:idmap v:ext=3D"edit" data=3D"1" />
</o:shapelayout></xml><![endif]-->
</head>
<body bgcolor=3D"white" lang=3D"FR" link=3D"#0563C1" vlink=3D"#954F72">
<div class=3D"WordSection1">
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"color:windowtext">From=
 what I understood, in your case you might solve your issue by using specif=
ic key classes instead of Strings.
<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"color:windowtext"><o:p=
>&nbsp;</o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"color:windowtext">Mayb=
e you could create key classes that have a user-specified hashcode that cou=
ld take the previous key&#8217;s hashcode as a value. That way your data sh=
ouldn&#8217;t be sent over the wire and stay in the
 same partition thus on the same taskmanager..<o:p></o:p></span></p>
</div>
</body>
</html>

--_000_VI1PR07MB3357ACB169C59559EC6A1599F72B0VI1PR07MB3357eurp_--