lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bernd Fehling (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SOLR-3307) DIH FileListEntityProcessor not multi-threading after applying patch SOLR-3011
Date Tue, 03 Apr 2012 08:17:19 GMT

    [ https://issues.apache.org/jira/browse/SOLR-3307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245053#comment-13245053
] 

Bernd Fehling commented on SOLR-3307:
-------------------------------------

Excellent, works now as expected.

Now its getting more difficult because when loading a large amount of records each index segment
gets a ".del" file of different size.
Nevertheless all data is loaded without loss and an optimize will clean up everything.
Obviously another bad side effect of multi-threading and NOT seen with version 3.5.
Will be hard to find out what happens. 
An overlapping of solrwriter?


Does it make sence to spend more time looking into this if multi-threading will be removed
anyway in 4.x?

                
> DIH FileListEntityProcessor not multi-threading after applying patch SOLR-3011
> ------------------------------------------------------------------------------
>
>                 Key: SOLR-3307
>                 URL: https://issues.apache.org/jira/browse/SOLR-3307
>             Project: Solr
>          Issue Type: Bug
>          Components: contrib - DataImportHandler
>    Affects Versions: 3.6
>            Reporter: Bernd Fehling
>            Assignee: James Dyer
>             Fix For: 3.6
>
>         Attachments: SOLR-3307-UnitTest.patch, SOLR-3307.patch
>
>
> As reported in issue SOLR-3011 the FileListEntityProcessor is not recursing through all
sub-directories and files after applying SOLR-3011.patch.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message