Mailing-List: contact dev-help@ignite.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@ignite.apache.org
MIME-Version: 1.0
In-Reply-To: <CABuYRco5dFmFWadwmzNikYFdJnv-p5Q0jYEAzW9M8abUJ8TbJg@mail.gmail.com>
References: <CALH+G9rMKBQuR4hO4J79W=RDUAu2+Wiu4mB7WHZX6DWp7ZwkmQ@mail.gmail.com>
 <CA+0=VoX961mKCBq29w9YM47p1vNy+UoC=TWoRJRD2hWWF7DTxg@mail.gmail.com>
 <CALH+G9onoK4FQMKRyWa4dgRCqhDR2m-7-HHiU2gbrj0gv-c1iQ@mail.gmail.com>
 <CA+0=VoV_4=w9z=WCnBaE1C2VyqVOY=RmOYY-QjUYPg+csGqNpg@mail.gmail.com>
 <CALH+G9pWvUgn=a-fjfEce8TTjh85AJbYtv-swY8dsOOsTowCDw@mail.gmail.com>
 <CA+0=VoU5z6kp6En34QOqpaEbaBdSWiP50E4RUsB__-PW978-Rg@mail.gmail.com>
 <CABuYRcraW72vEMazd-XQNz0UgCA_oLxCCF619VLnfEeaUFRYgw@mail.gmail.com>
 <CA+0=VoWcAQy1D6h0d-WqM117SvVtxMR_KqzVY_qSyuOF=DiHfA@mail.gmail.com> <CABuYRco5dFmFWadwmzNikYFdJnv-p5Q0jYEAzW9M8abUJ8TbJg@mail.gmail.com>
From: Dmitriy Setrakyan <dsetrakyan@apache.org>
Date: Mon, 3 Jul 2017 15:39:05 -0700
Message-ID: <CA+0=VoVfZZYuUhZMZ-ZkDgndropW0VqV=BmRqHP+aRxgO3hT3g@mail.gmail.com>
Subject: Re: Distributed scheduling
To: dev@ignite.apache.org
Content-Type: multipart/alternative; boundary="001a1146ee3ea15359055371712d"
archived-at: Mon, 03 Jul 2017 22:39:48 -0000

--001a1146ee3ea15359055371712d
Content-Type: text/plain; charset="UTF-8"

Hm... I think we should definitely make our services durable. Everything in
Ignite should be durable now.

As far as scheduling, makes sense as well. Let's make it durable too.

D.

On Mon, Jul 3, 2017 at 3:35 PM, Valentin Kulichenko <
valentin.kulichenko@gmail.com> wrote:

> Dmitry,
>
> Yes, this can be implemented using services in many cases, but:
>
> - It will require user to implement actual scheduling logic. It's quite a
> generic task, so I think it makes sense to have it directly on the API.
> - Most likely it will imply deploying separate service for each scheduled
> task. I don't think it's a very good idea.
> - Current services implementation is not durable. If cluster is restarted,
> all services are lost.
>
> -Val
>
> On Sat, Jul 1, 2017 at 12:34 AM, Dmitriy Setrakyan <dsetrakyan@apache.org>
> wrote:
>
> > Val,
> >
> > In this case, we should have a notion of a named scheduler and ensure
> that
> > we don't schedule the same task more than once. This is beginning to look
> > more like a durable cluster singleton service, no?
> >
> > D.
> >
> > On Fri, Jun 30, 2017 at 1:39 PM, Valentin Kulichenko <
> > valentin.kulichenko@gmail.com> wrote:
> >
> > > I think this functionality should provide durable way of scheduled task
> > or
> > > closure execution on the cluster. Job descriptors should be persisted
> on
> > > server side and executed there.
> > >
> > > As for API, I believe this should be part of Compute Grid. I suggest to
> > > introduce IgniteCompute#withSchedulingPolicy(SchedulingPolicy policy)
> > > method, where SchedulingPolicy is smth like this:
> > >
> > > public interface SchedulingPolicy {
> > >     /**
> > >      * @return Timestamp of next execution.
> > >      */
> > >     public Date nextTime();
> > > }
> > >
> > > This will enable scheduling for all compute features (tasks, callables,
> > > closures, etc.) and also very flexible. Policy implementation can
> provide
> > > simple periodic scheduling, scheduling based on Cron or anything else.
> > >
> > > Thoughts?
> > >
> > > -Val
> > >
> > > On Fri, Jun 30, 2017 at 7:55 AM, Dmitriy Setrakyan <
> > dsetrakyan@apache.org>
> > > wrote:
> > >
> > > > On Fri, Jun 30, 2017 at 12:29 AM, Alexey Kuznetsov <
> > > akuznetsov@apache.org>
> > > > wrote:
> > > >
> > > > > Dmitriy,
> > > > >
> > > > > >> Can you provide a simple example of API calls that will make
> this
> > > > > possible?
> > > > > API could be like this:
> > > > > 1) via scheduler:
> > > > > Ignite ignite = Ignition.start(....);
> > > > >
> > > > > ignite.scheduler().schedulel(job, "0 0 * * *"); // This will
> execute
> > > job
> > > > > every day at 00:00
> > > > >
> > > > > 2) via compute
> > > > >
> > > > > Ignite ignite = Ignition.start(....);
> > > > >
> > > > > ignite.compute().schedulel(task, "0 0 * * *"); // This will
> execute
> > > > > compute
> > > > > task every day at 00:00
> > > > >
> > > > > Make sense?
> > > > >
> > > > >
> > > > Yes, it does, but I am failing to see how is this a *distributed*
> > > > scheduling. Are we persisting the scheduler somewhere in the cluster
> or
> > > is
> > > > it only triggered on the client side?
> > > >
> > >
> >
>

--001a1146ee3ea15359055371712d--