lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yonik Seeley (JIRA)" <>
Subject [jira] Commented: (LUCENE-2779) Use ConcurrentHashMap in RAMDirectory
Date Sun, 28 Nov 2010 17:09:37 GMT


Yonik Seeley commented on LUCENE-2779:

bq. I checked CHM iterators and they are safe w.r.t the map being modified after the iterator
was obtained.

Yes, but that wasn't the problem.  The iterator for ketSet "guarantees to traverse elements
as they existed upon construction of the iterator".
The real problem is that the String[] is created based on the size of the keySet, and then
later, an iterator is created over the keySet.  If an addition to the set is done between
those two events, the iterator will traverse more elements than there is room for - hence
the AIOB exception.

 bq. About remove I'll have to look in the code (not near the comp now) - but I had a feeling
that it is safe too, b/c the file is first removed,

The createOutput issue is that get() was used (not remove) so multiple threads could overwrite
the same file and all of them subtract the size.

> Use ConcurrentHashMap in RAMDirectory
> -------------------------------------
>                 Key: LUCENE-2779
>                 URL:
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: Store
>            Reporter: Shai Erera
>            Assignee: Shai Erera
>            Priority: Minor
>             Fix For: 3.1, 4.0
>         Attachments: LUCENE-2779.patch
> RAMDirectory synchronizes on its instance in many places to protect access to map of
RAMFiles, in addition to updating the sizeInBytes member. In many places the sync is done
for 'read' purposes, while only in few places we need 'write' access. This looks like a perfect
use case for ConcurrentHashMap
> Also, syncing around sizeInBytes is unnecessary IMO, since it's an AtomicLong ...
> I'll post a patch shortly.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message