lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SOLR-9120) LukeRequestHandler logs WARN "Error getting file length for [segments_NNN]" for inconsequential NoSuchFileException situations -- looks scary but is not a problem, logging should be reduced
Date Thu, 09 Nov 2017 16:55:01 GMT

    [ https://issues.apache.org/jira/browse/SOLR-9120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16246012#comment-16246012
] 

ASF subversion and git services commented on SOLR-9120:
-------------------------------------------------------

Commit 15fe53e10be74a0c953c4e0fac6815798cf66772 in lucene-solr's branch refs/heads/master
from Chris Hostetter
[ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=15fe53e ]

SOLR-9120: Reduce log level for inconsequential NoSuchFileException that LukeRequestHandler
may encounter


> LukeRequestHandler logs WARN "Error getting file length for [segments_NNN]" for inconsequential
NoSuchFileException situations -- looks scary but is not a problem, logging should be reduced
> ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: SOLR-9120
>                 URL: https://issues.apache.org/jira/browse/SOLR-9120
>             Project: Solr
>          Issue Type: Improvement
>    Affects Versions: 5.5, 6.0
>            Reporter: Markus Jelsma
>            Assignee: Hoss Man
>         Attachments: SOLR-9120.patch, SOLR-9120.patch, SOLR-9120.patch
>
>
> Begining with Solr 5.5, the LukeRequestHandler started attempting to report the name
and file size of the segments file for the _current_ Searcher+IndexReader in use by Solr --
however the filesize information is not always available from the Directory in cases where
"on disk" commits have caused that file to be removed, for example...
> * you perform index updates & commits w/o "newSearcher" being opened
> * you "concurrently" make requests to the LukeRequestHandler or the CoreAdminHandler
requesting "STATUS" (ie: after the commit, before any newSearcher)
> ** these requests can come from the Admin UI passively if it's open in a browser
> In situations like this, a decision was made in SOLR-8587 to log a WARNing in the event
that the segments file size could not be determined -- but these WARNing messages look scary
and have lead (many) users to assume something is wrong with their solr index.
> We should reduce the severity of these log messages, and improve the wording to make
it more clear that this is not a fundemental problem with the index.
> ----
> Here's some trivial steps to reproduce the WARN message...
> {noformat}
> $ bin/solr -e techproducts
> ...
> $ tail -f example/techproducts/logs/solr.log
> ...
> {noformat}
> In another terminal...
> {noformat}
> $ curl -H 'Content-Type: application/json' 'http://localhost:8983/solr/techproducts/update?commit=true&openSearcher=false'
--data-binary '[{"id":"HOSS"}]'
> ...
> $ curl 'http://localhost:8983/solr/techproducts/admin/luke'
> ...
> {noformat}
> When the "/admin/luke" URL is hit, this will show up in the logs – but the luke request
will finish correctly...
> {noformat}
> WARN  - 2017-11-08 17:23:44.574; [   x:techproducts] org.apache.solr.handler.admin.LukeRequestHandler;
Error getting file length for [segments_2]
> java.nio.file.NoSuchFileException: /home/hossman/lucene/dev/solr/example/techproducts/solr/techproducts/data/index/segments_2
> 	at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
> 	at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
> 	at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
> 	at sun.nio.fs.UnixFileAttributeViews$Basic.readAttributes(UnixFileAttributeViews.java:55)
> 	at sun.nio.fs.UnixFileSystemProvider.readAttributes(UnixFileSystemProvider.java:144)
> 	at sun.nio.fs.LinuxFileSystemProvider.readAttributes(LinuxFileSystemProvider.java:99)
> 	at java.nio.file.Files.readAttributes(Files.java:1737)
> 	at java.nio.file.Files.size(Files.java:2332)
> 	at org.apache.lucene.store.FSDirectory.fileLength(FSDirectory.java:243)
> 	at org.apache.lucene.store.NRTCachingDirectory.fileLength(NRTCachingDirectory.java:128)
> 	at org.apache.solr.handler.admin.LukeRequestHandler.getFileLength(LukeRequestHandler.java:611)
> 	at org.apache.solr.handler.admin.LukeRequestHandler.getIndexInfo(LukeRequestHandler.java:584)
> 	at org.apache.solr.handler.admin.LukeRequestHandler.handleRequestBody(LukeRequestHandler.java:136)
> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
> ...
> INFO  - 2017-11-08 17:23:44.587; [   x:techproducts] org.apache.solr.core.SolrCore; [techproducts]
 webapp=/solr path=/admin/luke params={} status=0 QTime=15
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message