lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Upayavira ...@odoko.co.uk>
Subject Re: Indexing issue - index get deleted
Date Wed, 10 Jun 2015 11:11:33 GMT
I was only speaking about full import regarding the default of
clean=true. However, looking at the source code, it doesn't seem to
differentiate especially between a full and a delta in relation to the
default of clean=true, which would be pretty crappy. However, I'd need
to try it.

Upayavira

On Wed, Jun 10, 2015, at 11:57 AM, Alessandro Benedetti wrote:
> Wow, Upaya, I didn't know that clean was default=true in the delta import
> as well!
> I did know it was default in the full import, but I agree with you that
> having a default to true for delta import is very dangerous !
> 
> But assuming the user was using the delta import so far, if cleaning
> every
> time, how was possible to have a coherent index ?
> 
> Using a delta import with clean=true should produce a non consistent
> index
> with only a subset ( the latest modified) of the entire data set !
> 
> Cheers
> 
> 2015-06-10 11:46 GMT+01:00 Upayavira <uv@odoko.co.uk>:
> 
> > Note the clean= parameter to the DIH. It defaults to true. It will wipe
> > your index before it runs. Perhaps it succeeded at wiping, but failed to
> > connect to your database. Hence an empty DB?
> >
> > clean=true is, IMO, a very dangerous default option.
> >
> > Upayavira
> >
> > On Wed, Jun 10, 2015, at 10:59 AM, Midas A wrote:
> > > Hi Alessandro,
> > >
> > > Please find the answers inline and help me out to figure out this
> > > problem.
> > >
> > > 1) Solr version : *4.2.1*
> > > 2) Solr architecture :* Master -slave/ Replication with requestHandler*
> > >
> > > 3) Kind of data source indexed : *Mysql *
> > > 4) What happened to the datasource ? any change in there ? : *No change *
> > > 5) Was the index actually deleted ? All docs deleted ? Index file
> > > segments
> > > deleted ? Index corrupted ? : *all docs deleted , segment files  are
> > > there.
> > > index file is also there .*
> > > 6) What about system resources ?
> > > * JVM: 30 GB*
> > > * RAM: 48 GB*
> > >
> > > *CPU : 8 core*
> > >
> > >
> > > On Wed, Jun 10, 2015 at 2:13 PM, Alessandro Benedetti <
> > > benedetti.alex85@gmail.com> wrote:
> > >
> > > > Let me try to help you, first of all I would like to encourage people
> > to
> > > > post more information about their scenario than "This is my log, index
> > > > deleted, help me" :)
> > > >
> > > > This kind of Info can be really useful :
> > > >
> > > > 1) Solr version
> > > > 2) Solr architecture ( Solr Cloud ? Solr Cloud configuration ? Manual
> > > > Sharding ? Manual Replication ? where the problem happened ? )
> > > > 3) Kind of data source indexed
> > > > 4) What happened to the datasource ? any change in there ?
> > > > 5) Was the index actually deleted ? All docs deleted ? Index file
> > segments
> > > > deleted ? Index corrupted ?
> > > > 6) What about system resources ?
> > > >
> > > > These questions are only few example one that everyone should always
> > post
> > > > along their mysterious problem !
> > > >
> > > > Hope this helps,
> > > >
> > > > Cheers
> > > >
> > > >
> > > > 2015-06-10 9:15 GMT+01:00 Midas A <test.midas@gmail.com>:
> > > >
> > > > >
> > > > > We are running full import and delta import crons .
> > > > >
> > > > > Fulll index once a day
> > > > >
> > > > > delta index : every 10 mins
> > > > >
> > > > >
> > > > > last night my index automatically deleted(numdocs=0).
> > > > >
> > > > > attaching logs for review .
> > > > >
> > > > > please suggest to resolve the issue.
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > --------------------------
> > > >
> > > > Benedetti Alessandro
> > > > Visiting card : http://about.me/alessandro_benedetti
> > > >
> > > > "Tyger, tyger burning bright
> > > > In the forests of the night,
> > > > What immortal hand or eye
> > > > Could frame thy fearful symmetry?"
> > > >
> > > > William Blake - Songs of Experience -1794 England
> > > >
> >
> 
> 
> 
> -- 
> --------------------------
> 
> Benedetti Alessandro
> Visiting card : http://about.me/alessandro_benedetti
> 
> "Tyger, tyger burning bright
> In the forests of the night,
> What immortal hand or eye
> Could frame thy fearful symmetry?"
> 
> William Blake - Songs of Experience -1794 England

Mime
View raw message