couchdb-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Damien Katz <dam...@apache.org>
Subject Re: runaway compaction
Date Tue, 23 Dec 2008 01:51:44 GMT
Can't work, the storage file will have data that points to previously  
written data. Copying the raw bytes means the structures point to  
random places in the new file.

-Damien

On Dec 22, 2008, at 8:45 PM, Chris Anderson wrote:

> On Mon, Dec 22, 2008 at 5:29 PM, Damien Katz <damien@apache.org>  
> wrote:
>> It's a known issue that compaction maybe cannot complete under  
>> heavy write
>> load. At some point maybe we should implement a mechanism to  
>> throttle writes
>> if the compaction isn't making enough progress during updates.
>>
>
> Would it be possible to artificially "complete" compaction by
> appending the last few sections of the original file verbatim to the
> new file? Maybe after the second pass it could just copy over
> uncompacted updates... maybe the whole idea is too dirty.
>
> -- 
> Chris Anderson
> http://jchris.mfdz.com


Mime
View raw message