incubator-s4-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sky Zhao <>
Subject RE: About Data send to Nodes
Date Mon, 22 Jul 2013 05:01:00 GMT
Yes´╝îI rewrote the onInit method in AdaterApp and set keyFinder into it, then partition  works,
the default Hash method always keep even distribution right?
Thanks Matthieu.

From: Matthieu Morel []
Sent: Wednesday, July 17, 2013 9:44 PM
Subject: Re: About Data send to Nodes

On Jul 17, 2013, at 09:01 , Sky Zhao <<>>

Hi Matthieu,

Can you give concrete example to do this,

I tried A,B use same key, C,D also does, but result still A,C in NODE1, B,D in NODE2,

I don't see how this can happen with same key values and correct key finder. Please make sure
you have the same key values and that the keyfinder is indeed extracting the key value.

I think the zk has average assignment follow the sequence orders, how to change this, thanks

The issue is not related to zookeeper. The problem might be your keyfinder.



From: Matthieu Morel [<>]
Sent: Friday, July 12, 2013 10:17 PM
Subject: Re: About Data send to Nodes

On Jul 12, 2013, at 06:17 , Sky Zhao <<>>

If having data sequence A,B,C,D,
And two Nodes, node1, node2,
Can we specify the AB sent to Node1, CD sent to Node2,
Is there any way to handle specified data.

One way would be to use the same key for A,B and C,D, and use a custom hashing function that
guarantees those 2 keys are hashed to 2 different nodes.



View raw message