lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yonik Seeley (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SOLR-2700) transaction logging
Date Wed, 24 Aug 2011 23:41:29 GMT

    [ https://issues.apache.org/jira/browse/SOLR-2700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13090615#comment-13090615
] 

Yonik Seeley commented on SOLR-2700:
------------------------------------

Just to get a rough idea of performance, I uploaded one of my CSV test files (765MB, 100M
docs, 7 small string fields per doc).
Time to complete indexing was 42% longer, and the transaction log grew to 1.8GB.  The lucene
index was 1.2GB.  The log was on the same device, so the main impact may have been disk IO.

> transaction logging
> -------------------
>
>                 Key: SOLR-2700
>                 URL: https://issues.apache.org/jira/browse/SOLR-2700
>             Project: Solr
>          Issue Type: New Feature
>            Reporter: Yonik Seeley
>         Attachments: SOLR-2700.patch, SOLR-2700.patch, SOLR-2700.patch, SOLR-2700.patch,
SOLR-2700.patch
>
>
> A transaction log is needed for durability of updates, for a more performant realtime-get,
and for replaying updates to recovering peers.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message