lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Adrien Grand (JIRA)" <>
Subject [jira] [Updated] (LUCENE-5373) Lucene42DocValuesProducer.ramBytesUsed is over-estimated
Date Fri, 20 Dec 2013 11:12:09 GMT


Adrien Grand updated LUCENE-5373:

    Attachment: LUCENE-5373.patch

New version of the patch with Lucene40DocValuesProducer as well. Unless I missed something,
{{RamUsageEstimator.sizeOf(Object)}} is not called by {{SegmentReader.ramBytesUsed()}} anymore.

You may still see calls to {{RamUsageEstimator.sizeOf(native array)}} but these methods are
actually both accurate and fast: they basically just compute {{NUM_BYTES_ARRAY_HEADER + length
* NUM_BYTES_element}} and return an aligned size.

> Lucene42DocValuesProducer.ramBytesUsed is over-estimated
> --------------------------------------------------------
>                 Key: LUCENE-5373
>                 URL:
>             Project: Lucene - Core
>          Issue Type: Bug
>            Reporter: Adrien Grand
>            Assignee: Adrien Grand
>            Priority: Minor
>         Attachments: LUCENE-5373.patch, LUCENE-5373.patch, LUCENE-5373.patch, LUCENE-5373.patch
> Lucene42DocValuesProducer.ramBytesUsed uses {{RamUsageEstimator.sizeOf(this)}} to return
an estimation of the memory usage. One of the issues (there might be other ones) is that this
class has a reference to an IndexInput that might link to other data-structures that we wouldn't
want to take into account. For example, index inputs of a {{RAMDirectory}} all point to the
directory itself, so {{Lucene42DocValuesProducer.ramBytesUsed}} would return the amount of
memory used by the whole directory.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message