ignite-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Karun Chand <buckeyeka...@gmail.com>
Subject Re: Some questions about store and distributed processing
Date Sat, 26 Jan 2019 16:13:10 GMT
Hi Yann,

Event listeners in Ignite can be helpful to you -
You can listen for specific types of events (like cache put, cache read) on
a local node or remote events on a group of cluster nodes and then perform
whatever actions you want.
All the different event types that exist for Ignite version 2.7 can be seen
here -
EVT_CACHE_OBJECT_PUT is probably what you are looking for.


On Sat, Jan 26, 2019 at 2:41 AM yann Blazart <yann.blazart@gmail.com> wrote:

> Hello all !
> I will have to use Ignite because I think it's the best solution to all my
> concerns, but I have a few question.
> I have to process very big json files (200GB), with lot of objects of
> different type generated from it.
> These objects, I will have to do multiple controls on it (with a dsl), and
> check  unicity, and in the end do some complexe join request between them.
> So for complexe request, ok, I store all in partitionned tables, and do
> request, easy.
> But for all the dsl rule ton apply on each object, It could be very nice
> if it can be applied when it's stored on the node, instead of doing it when
> I read the file, I mean :
> cache.putAll(mymap);
> then something on node to say :  new Entry listener -> execute dsl rules.
> I think I can gain lot of processing time like that. But is it possible ?
> I checked the doc, but I only see ways to 1st store all then run dsl rule
> on all node.
> Thanks in advance ;)
> Regards

View raw message