ignite-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrey Kornev <andrewkor...@hotmail.com>
Subject RE: Initial data load and indexes
Date Fri, 08 May 2015 16:54:14 GMT
There is one situation where disabling indexing during the data load might make a difference.
When the source of my data is a log-based store (like Kafka) with multiple versions of the
same fact, I'd really want to play the entire log back first, and then get the cache indexed...

Andrey

> Date: Fri, 8 May 2015 23:16:02 +0700
> Subject: Re: Initial data load and indexes
> From: akuznetsov@gridgain.com
> To: dev@ignite.incubator.apache.org
> 
> My main point is avoid not needed GC.
> Vasiliy and Pavel will prepare test for you.
> 
> On Fri, May 8, 2015 at 10:48 PM, Sergi Vladykin <sergi.vladykin@gmail.com>
> wrote:
> 
> > It does not make any sense to disable indexing on data loading and to index
> > later because it is exactly the same amount of work.
> > Anyways lets create test and investigate this.
> >
> > Sergi
> >
> > 2015-05-08 11:39 GMT+03:00 Alexey Kuznetsov <akuznetsov@gridgain.com>:
> >
> > > Issue created: https://issues.apache.org/jira/browse/IGNITE-878
> > > Vasiliy will create simple test to reproduce issue.
> > > And after that will assign issue to Sergi.
> > >
> > > On Fri, May 8, 2015 at 3:33 PM, Yakov Zhdanov <yzhdanov@apache.org>
> > wrote:
> > >
> > > > Sergi, please take a look at this.
> > > >
> > > > --Yakov
> > > >
> > > > 2015-05-08 6:51 GMT+03:00 Alexey Kuznetsov <akuznetsov@gridgain.com>:
> > > >
> > > > > Hi,
> > > > >
> > > > > When I do initial load of data (with a lot of indexed fields) into
a
> > > > cache
> > > > > I see GC activity on indexing internal objects.
> > > > >
> > > > > It is possible to turn off reindexing while I'm loading data and
do
> > > > reindex
> > > > > after initial load is done?
> > > > >
> > > > > --
> > > > > Alexey Kuznetsov
> > > > > GridGain Systems
> > > > > www.gridgain.com
> > > > >
> > > >
> > >
> > >
> > >
> > > --
> > > Alexey Kuznetsov
> > > GridGain Systems
> > > www.gridgain.com
> > >
> >
> 
> 
> 
> -- 
> Alexey Kuznetsov
> GridGain Systems
> www.gridgain.com
 		 	   		  
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message