lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Uwe Schindler (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (LUCENE-7582) NIOFSDirectory sometime doesn't work on windows
Date Tue, 06 Dec 2016 11:11:29 GMT

    [ https://issues.apache.org/jira/browse/LUCENE-7582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15724990#comment-15724990
] 

Uwe Schindler commented on LUCENE-7582:
---------------------------------------

Hi,
use FSDirectory.open static factory. It will choose the best implementation automatically
depending on Operating System. On Windows this will choose MMapDircetory for 64 bit platforms
and SimpleFSDirectory on 32 bit platforms. This is perfectly fine. Keep in min that SImpleFSDirectory
is not "slow" , it just does not perform well in multithreaded environments (many parallel
searches). But on 32 bit platforms it is unlikely that you have many parallel searches! 32
bit VMs are mostly used for stuff like local mail search engines or other pure client/GUI
apps.

Async FileChannel does not work and slows down immense for synchronous IO like Lucene does,
because you need additional client code synchronization. It gets like 2 times slower than
SimpleFSDirectory.

> NIOFSDirectory sometime doesn't work on windows
> -----------------------------------------------
>
>                 Key: LUCENE-7582
>                 URL: https://issues.apache.org/jira/browse/LUCENE-7582
>             Project: Lucene - Core
>          Issue Type: Bug
>          Components: core/store
>    Affects Versions: 5.3.1
>         Environment: Windows 10, 32 bits JVM
>            Reporter: Kevin Senechal
>
> Hi!
> I've an error using lucene on windows. I already post a question on modeshape forum (https://developer.jboss.org/thread/273070)
and it looks that NIOFSDirectory is not working well on windows as described in the java documentation
of this class.
> {quote}NOTE: NIOFSDirectory is not recommended on Windows because of a bug in how FileChannel.read
is implemented in Sun's JRE. Inside of the implementation the position is apparently synchronized.
See here for details.{quote}
> After reading the linked java issue (http://bugs.java.com/bugdatabase/view_bug.do?bug_id=6265734),
it seems that there is a workaround to solve it, use an AsynchronousFileChannel.
> Is it a choice that has been made to not use AsynchronousFileChannel or will it be a
good fix?
> You'll find the complete stacktrace below:
> {code:java}
> Caused by: org.modeshape.jcr.index.lucene.LuceneIndexException: Cannot commit index writer
 
>   at org.modeshape.jcr.index.lucene.LuceneIndex.commit(LuceneIndex.java:155) ~[dsdk-launcher.jar:na]
 
>   at org.modeshape.jcr.spi.index.provider.IndexChangeAdapter.completeWorkspaceChanges(IndexChangeAdapter.java:104)
~[dsdk-launcher.jar:na]  
>   at org.modeshape.jcr.cache.change.ChangeSetAdapter.notify(ChangeSetAdapter.java:157)
~[dsdk-launcher.jar:na]  
>   at org.modeshape.jcr.spi.index.provider.IndexProvider$AtomicIndex.notify(IndexProvider.java:1493)
~[dsdk-launcher.jar:na]  
>   at org.modeshape.jcr.bus.RepositoryChangeBus.notify(RepositoryChangeBus.java:190) ~[dsdk-launcher.jar:na]
 
>   at org.modeshape.jcr.cache.document.WorkspaceCache.changed(WorkspaceCache.java:333)
~[dsdk-launcher.jar:na]  
>   at org.modeshape.jcr.txn.SynchronizedTransactions.updateCache(SynchronizedTransactions.java:223)
~[dsdk-launcher.jar:na]  
>   at org.modeshape.jcr.cache.document.WritableSessionCache.save(WritableSessionCache.java:751)
~[dsdk-launcher.jar:na]  
>   at org.modeshape.jcr.JcrSession.save(JcrSession.java:1171) ~[dsdk-launcher.jar:na]
 
>   ... 19 common frames omitted  
> Caused by: java.nio.file.FileSystemException: C:\Users\Christopher\Infiltrea3CLOUDTEST8\christopher@dooapp.com\indexes\default\nodesByPath\_dc_Lucene50_0.doc:
The process cannot access the file because it is being used by another process.  
>   at sun.nio.fs.WindowsException.translateToIOException(WindowsException.java:86) ~[na:1.8.0_92]
 
>   at sun.nio.fs.WindowsException.rethrowAsIOException(WindowsException.java:97) ~[na:1.8.0_92]
 
>   at sun.nio.fs.WindowsException.rethrowAsIOException(WindowsException.java:102) ~[na:1.8.0_92]
 
>   at sun.nio.fs.WindowsFileSystemProvider.newFileChannel(WindowsFileSystemProvider.java:115)
~[na:1.8.0_92]  
>   at java.nio.channels.FileChannel.open(FileChannel.java:287) ~[na:1.8.0_92]  
>   at java.nio.channels.FileChannel.open(FileChannel.java:335) ~[na:1.8.0_92]  
>   at org.apache.lucene.util.IOUtils.fsync(IOUtils.java:393) ~[dsdk-launcher.jar:na] 

>   at org.apache.lucene.store.FSDirectory.fsync(FSDirectory.java:281) ~[dsdk-launcher.jar:na]
 
>   at org.apache.lucene.store.FSDirectory.sync(FSDirectory.java:226) ~[dsdk-launcher.jar:na]
 
>   at org.apache.lucene.store.LockValidatingDirectoryWrapper.sync(LockValidatingDirectoryWrapper.java:62)
~[dsdk-launcher.jar:na]  
>   at org.apache.lucene.index.IndexWriter.startCommit(IndexWriter.java:4456) ~[dsdk-launcher.jar:na]
 
>   at org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:2874)
~[dsdk-launcher.jar:na]  
>   at org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2977) ~[dsdk-launcher.jar:na]
 
>   at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2944) ~[dsdk-launcher.jar:na]
 
>   at org.modeshape.jcr.index.lucene.LuceneIndex.commit(LuceneIndex.java:152) ~[dsdk-launcher.jar:na]

> {code}
> Thank you in advance for your help



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message