ignite-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Alexey Kuznetsov <akuznet...@gridgain.com>
Subject Re: Data Snapshots in Ignite
Date Thu, 22 Oct 2015 12:01:35 GMT
>> Not sure how CQEngine will help for snapshotting of Ignite. Can you
explain?

There was a discussion about this lib has various types of indexes that
could be only created on read-only data.

But it seems that indeed my note has a little value for this thread.

On Thu, Oct 22, 2015 at 2:31 PM, Dmitriy Setrakyan <dsetrakyan@apache.org>
wrote:

> Not sure how CQEngine will help for snapshotting of Ignite. Can you
> explain?
>
> On Wed, Oct 21, 2015 at 7:48 PM, Alexey Kuznetsov <akuznetsov@gridgain.com
> >
> wrote:
>
> > Some time ago we already discussed snapshots idea while discussing
> library
> > "cqengine" [1].
> >
> > May be this library could be useful in snapshot mode.
> >
> > [1] Sources: https://github.com/npgall/cqengine
> >      Docs: https://code.google.com/p/cqengine/
> >
> > On Thu, Oct 22, 2015 at 8:48 AM, Konstantin Boudnik <cos@apache.org>
> > wrote:
> >
> > > On Wed, Oct 21, 2015 at 05:58PM, Dmitriy Setrakyan wrote:
> > > > On Wed, Oct 21, 2015 at 4:48 PM, Konstantin Boudnik <cos@apache.org>
> > > wrote:
> > > >
> > > > > I like it quite a bit, as well! Ticket would make the most sense
as
> > > well,
> > > > > so
> > > > > there will be a single place to collect the design docs (if
> needed),
> > > etc.
> > > > >
> > > > > On Wed, Oct 21, 2015 at 04:45PM, Dmitriy Setrakyan wrote:
> > > > > > I also really like the idea. One potential use case is fraud
> > > analysis in
> > > > > > financial institutions. Rarely it makes sense to perform such
> > > analysis
> > > > > on a
> > > > > > life system, but rather a snapshot of some data needs to be
taken
> > and
> > > > > > analyzed offline.
> > > > > >
> > > > > > I think snapshots should be saved to disk, so users could load
> them
> > > for
> > > > > > analysis on a totally different cluster.
> > > > >
> > > > > I think disk persistence should be optional, not mandatory.
> > > > >
> > > >
> > > > I would actually prefer to support disk-only snapshots. I think it
> will
> > > be
> > > > difficult (double-the-work) to support both, in-memory and disk
> > formats.
> > > > Also, storing snapshots in-memory would require extra memory (a lot
> of
> > > it)
> > > > for something that gets saved mainly for historic purposes or offline
> > > > analysis.
> > >
> > > Ah, good points! Agree.
> > >
> > >
> >
> >
> > --
> > Alexey Kuznetsov
> > GridGain Systems
> > www.gridgain.com
> >
>



-- 
Alexey Kuznetsov
GridGain Systems
www.gridgain.com

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message