lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Uwe Schindler" <...@thetaphi.de>
Subject RE: stucked indexing process
Date Wed, 12 Jul 2017 13:15:22 GMT
Hi,

 

to figure out if you system is using an SSD drive for the index directory, the merge scheduler
has to get the underlying mount point of the index directory. As there is no direct lookup
for that, it needs to list all mount points in the system with a Java7 FS function. And that
seems to hang for some reason. Could it be that you have a mount (like NFS or CIFS) that no
longer responds?

 

Just list all with “cat /proc/mounts” or the “mount” command and check if any of them
is stuck or no longer responding.

 

Uwe

 

-----

Uwe Schindler

Achterdiek 19, D-28357 Bremen

 <http://www.thetaphi.de/> http://www.thetaphi.de

eMail: uwe@thetaphi.de

 

From: Tamer Gur [mailto:tgur@ebi.ac.uk] 
Sent: Wednesday, July 12, 2017 12:29 PM
To: java-user@lucene.apache.org
Subject: stucked indexing process

 

Hi all,

we are having an issue in our indexing pipeline time to time our indexing process are stucked.
Following text&picture is from jvisualvm and it seems process is waiting at sun.nio.fs.UnixFileSystem$FileStoreIterator.hasNext()
method all the time. we are using lucene 5.4.1 and java  1.8.0_65-b17.

what can be the reason of this? 

Many Thanks

Tamer

text version

"           org.apache.lucene.facet.taxonomy.directory.DirectoryTaxonomyWriter.<init>()","100.0","73509067","73509067","3"
"            org.apache.lucene.facet.taxonomy.directory.DirectoryTaxonomyWriter.<init>()","100.0","73509067","73509067","3"
"             org.apache.lucene.facet.taxonomy.directory.DirectoryTaxonomyWriter.addCategory()","100.0","73509067","73509067","3"
"              org.apache.lucene.facet.taxonomy.directory.DirectoryTaxonomyWriter.internalAddCategory()","100.0","73509067","73509067","3"
"               org.apache.lucene.facet.taxonomy.directory.DirectoryTaxonomyWriter.addCategoryDocument()","100.0","73509067","73509067","3"
"                org.apache.lucene.facet.taxonomy.directory.DirectoryTaxonomyWriter.getTaxoArrays()","100.0","73509067","73509067","3"
"                 org.apache.lucene.facet.taxonomy.directory.DirectoryTaxonomyWriter.initReaderManager()","100.0","73509067","73509067","3"
"                  org.apache.lucene.index.ReaderManager.<init>()","100.0","73509067","73509067","3"
"                   org.apache.lucene.index.DirectoryReader.open()","100.0","73509067","73509067","3"
"                    org.apache.lucene.index.IndexWriter.getReader()","100.0","73509067","73509067","3"
"                     org.apache.lucene.index.IndexWriter.maybeMerge()","100.0","73509067","73509067","3"
"                      org.apache.lucene.index.ConcurrentMergeScheduler.merge()","100.0","73509067","73509067","3"
"                       org.apache.lucene.index.ConcurrentMergeScheduler.initDynamicDefaults()","100.0","73509067","73509067","3"
"                        org.apache.lucene.util.IOUtils.spins()","100.0","73509067","73509067","3"
"                         org.apache.lucene.util.IOUtils.spins()","100.0","73509067","73509067","3"
"                          org.apache.lucene.util.IOUtils.spinsLinux()","100.0","73509067","73509067","3"
"                           org.apache.lucene.util.IOUtils.getFileStore()","100.0","73509067","73509067","3"
"                            sun.nio.fs.UnixFileSystem$FileStoreIterator.hasNext()","100.0","73509067","73509067","3"

image version




Mime
  • Unnamed multipart/related (inline, None, 0 bytes)
View raw message