lucene-solr-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ryan McKinley (JIRA)" <j...@apache.org>
Subject [jira] Commented: (SOLR-272) SolrDocument performance testing
Date Sun, 24 Jun 2007 22:59:25 GMT

    [ https://issues.apache.org/jira/browse/SOLR-272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12507728
] 

Ryan McKinley commented on SOLR-272:
------------------------------------

running again.  this time added a dynamic field:

[100000] 	2074 :: 0.02074 mili/doc :: SolrInputDocument
[100000] 	2617 :: 0.02617 mili/doc :: LuceneInputDocument
[100000] 	1843 :: 0.01843 mili/doc :: DocumentBuilder
[1000000] 	16248 :: 0.016248 mili/doc :: SolrInputDocument
[1000000] 	21946 :: 0.021946 mili/doc :: LuceneInputDocument
[1000000] 	18618 :: 0.018618 mili/doc :: DocumentBuilder

For 100000, SolrInputDocument is slightly slower then DocuentBuilder, but for n=1000000 it
is slightly faster.  Any thoughts on why?  

Same test, running GC every 1000 docs
if( (i%1000) == 0 ) System.gc();

[100000] 	3728 :: 0.03728 mili/doc :: SolrInputDocument
[100000] 	3872 :: 0.03872 mili/doc :: LuceneInputDocument
[100000] 	3595 :: 0.03595 mili/doc :: DocumentBuilder
[1000000] 	33843 :: 0.033843 mili/doc :: SolrInputDocument
[1000000] 	39668 :: 0.039668 mili/doc :: LuceneInputDocument
[1000000] 	36950 :: 0.036950 mili/doc :: DocumentBuilder

> SolrDocument performance testing
> --------------------------------
>
>                 Key: SOLR-272
>                 URL: https://issues.apache.org/jira/browse/SOLR-272
>             Project: Solr
>          Issue Type: Test
>    Affects Versions: 1.3
>            Reporter: Ryan McKinley
>         Attachments: SOLR-272-SolrDocumentPerformanceTesting.patch, SOLR-272-SolrDocumentPerformanceTesting.patch
>
>
> In 1.3, we added SolrInputDocument -- a temporary class to hold document information.
 There is concern that this may be less then ideal performance-wise.
> To settle some concerns (mine included) I want to compare a few SolrDocument implementations
to make sure we are not doing something crazy.
> I implemented a LuceneInputDocument subclass of SolrInputDocument that stores its values
directly in Lucene Document (rather then a Map<String,Collection>).
> This is a quick test comparing:
> 1. Building documents with SolrInputDocument 
> 2. Building documents with LuceneInputDocument (same interface writing directly to Document)
> 3. using DocumentBuilder (solr 1.2, solr 1.1)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message