lucy-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gupta, Rajiv" <Rajiv.Gu...@netapp.com>
Subject RE: [lucy-user] LUCY_Folder_Open_Out_IMP at core/Lucy/Store/Folder.c line 119
Date Mon, 12 Dec 2016 10:26:44 GMT
Another thing I could not able to figure out how the time zone is getting changed after the
failure.

20161211 125058 [] [(_start_indexing_file) File to index: /u/smoke/presub/logs/cit-fg-adr-ndo-rtp.rajivg.1481473039.49384_cmode_1of1/001_check_log_size.log
Save Index location: /u/smoke/presub/logs/cit-fg-adr-ndo-rtp.rajivg.1481473039.49384_cmode_1of1/.lucyindex/1
FileSeek pointer start : 17794 Final Flag: 1
20161211 175059 [] ****************************************
20161211 175059 [] * FAIL: [FAILED]: Retrying to add doc at path: /u/smoke/presub/logs/cit-fg-adr-ndo-rtp.rajivg.1481473039.49384_cmode_1of1/.lucyindex/1
:  rename from '/u/smoke/presub/logs/cit-fg-adr-ndo-rtp.rajivg.1481473039.49384_cmode_1of1/.lucyindex/1/schema.temp'
to '/u/smoke/presub/logs/cit-fg-adr-ndo-rtp.rajivg.1481473039.49384_cmode_1of1/.lucyindex/1/schema_e4.json'
failed: No such file or directory
20161211 175059 [] *    LUCY_Schema_Write_IMP at core/Lucy/Plan/Schema.c line 429
20161211 175059 [] *    at /x/eng/bbrtp/users/rajivg/dotdev_052309_4015413_1612060522/test/nate/bin/../lib/NATE/LucyIndexerUtils.pm
line 3278, <$fhlogfile> line 46.
20161211 175059 [] *    eval {...} called at /x/eng/bbrtp/users/rajivg/dotdev_052309_4015413_1612060522/test/nate/bin/../lib/NATE/LucyIndexerUtils.pm
line 3265
20161211 175059 [] *    NATE::LucyIndexerUtils::_lucy_add_doc('NATE::LucyIndexerUtils=HASH(0x2917050)',
'HASH(0x3116398)') called at /x/eng/bbrtp/users/rajivg/dotdev_052309_4015413_1612060522/test/nate/bin/../lib/NATE/LucyIndexerUtils.pm
line 3169

It is exactly shifting by 5 hrs. from EST. These logs are nothing but the STDOUT moving to
one file and I'm using localtime(time()) and format it to generate the time string.

Thanks,
Rajiv Gutpta



-----Original Message-----
From: Gupta, Rajiv 
Sent: Monday, December 12, 2016 10:08 AM
To: user@lucy.apache.org
Subject: RE: [lucy-user] LUCY_Folder_Open_Out_IMP at core/Lucy/Store/Folder.c line 119

Can't open '/u/smoke/presub/logs/cit-fg-adr-neg-rtp.rajivg.1481473130.41339_cmode_1of1/.lucyindex/1/seg_fd/lexicon-7.ixix':
Invalid argument
20161211 182109 [] *    LUCY_FSFolder_Local_Open_FileHandle_IMP at core/Lucy/Store/FSFolder.c
line 118
20161211 182109 [] *    LUCY_Folder_Local_Open_In_IMP at core/Lucy/Store/Folder.c line 101
20161211 182109 [] *    LUCY_Folder_Open_In_IMP at core/Lucy/Store/Folder.c line 75

There are two more failures they also failed due so similar reasons 

rename from '/u/smoke/presub/logs/cit-fg-adr-ndo-rtp.rajivg.1481473039.49384_cmode_1of1/.lucyindex/1/schema.temp'
to '/u/smoke/presub/logs/cit-fg-adr-ndo-rtp.rajivg.1481473039.49384_cmode_1of1/.lucyindex/1/schema_e4.json'
failed: No such file or directory

Can't delete 'lexicon-3.ix'

I believe all three are related to race condition while doing parallel indexing and should
go away with retries. However my retries started failing with different error which is strange
to me as if directory already exists shouldn't it skip from create attempt. 

20161211 182109 [] * FAIL: [FAILED]: Retrying to add doc at path: /u/smoke/presub/logs/cit-fg-adr-neg-rtp.rajivg.1481473130.41339_cmode_1of1/.lucyindex/1
:  Couldn't create directory '/u/smoke/presub/logs/cit-fg-adr-neg-rtp.rajivg.1481473130.41339_cmode_1of1/.lucyindex/1':
No such file or directory
20161211 182109 [] *    LUCY_FSFolder_Initialize_IMP at core/Lucy/Store/FSFolder.c line 102

So my all retry attempts were also failed. 


Now I have put one more condition on before Index creation if directory exists or not before
retry :(

My failure rate is now 7/10. Target to achieve at least 9/10.

-Rajiv


-----Original Message-----
From: Nick Wellnhofer [mailto:wellnhofer@aevum.de] 
Sent: Sunday, December 11, 2016 3:58 PM
To: user@lucy.apache.org
Subject: Re: [lucy-user] LUCY_Folder_Open_Out_IMP at core/Lucy/Store/Folder.c line 119

On 10/12/2016 17:25, Gupta, Rajiv wrote:
> Any timeline when 0.6.1 will be released?

0.6.1 is on schedule to be released in a few days.

Nick


Mime
View raw message