Mailing-List: contact user-help@zookeeper.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@zookeeper.apache.org
Received-SPF: error (athena.apache.org: local policy)
From: Jordan Zimmerman <jordan@jordanzimmerman.com>
Content-Type: multipart/alternative;
	boundary=Apple-Mail-0E59908F-3165-4DFF-840C-927D073BBB7E
Content-Transfer-Encoding: 7bit
Mime-Version: 1.0 (1.0)
Subject: Re: Implementing sharding with zookeeper
Message-Id: <FF9DDB53-8035-495B-91E3-FB2809BCA544@jordanzimmerman.com>
Date: Wed, 4 Feb 2015 13:02:50 -0800
References: 
 <CABWW-d1XbfcWACiSLeW9+-AbLOAGJ5xwcsN13dyMWi-uy=2aQQ@mail.gmail.com>
In-Reply-To: 
 <CABWW-d1XbfcWACiSLeW9+-AbLOAGJ5xwcsN13dyMWi-uy=2aQQ@mail.gmail.com>
To: "user@zookeeper.apache.org" <user@zookeeper.apache.org>

--Apple-Mail-0E59908F-3165-4DFF-840C-927D073BBB7E
Content-Type: text/plain;
	charset=us-ascii
Content-Transfer-Encoding: quoted-printable

I wrote something that might work for you. Have a look at Nirmata Workflow: =
 http://nirmataoss.github.io/workflow

=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
Jordan Zimmerman

> On Feb 4, 2015, at 12:10 PM, Vitalii Tymchyshyn <vit@tym.im> wrote:
>=20
> Hello.
>=20
> I have a task that looks like a fit for Zookeeper and I thought I find a
> recipe in Curator, but I dont. So, It looks like I need my own recipe.
>=20
> The problem is: we have a stream of tasks coming in. All tasks for the sam=
e
> account must be done sequential. But for different accounts it's OK to do
> in parallel, so we want workers to distribute account space between them.
>=20
> The first step, of course, is to make an account hash to ensure load is
> distributed as smooth as possible.
>=20
> Next I could simply use a lot of locks, but this way I can't ensure
> fairness.
>=20
> Thats why I think I need a Leader who will distribute (or redistribute in
> case of node death) the hash space between the live nodes.
>=20
> What do you think? May be I am missing something and there is existing
> recipe for the task?
>=20
> Best regards, Vitalii Tymchyshyn

--Apple-Mail-0E59908F-3165-4DFF-840C-927D073BBB7E--