incubator-couchdb-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dave Cottlehuber <...@jsonified.com>
Subject Re: Couchdb problem near period of low disk space
Date Fri, 19 Oct 2012 11:41:54 GMT
On 19 October 2012 06:48, Mark Hingston <mark.hingston@vardr.com> wrote:
> Hi guys,
>
> Apologies if this has been posted already but I couldn't find any related
> topics in the archives. I saw what looked like a crash in my couchdb server
> the other day - the relevant log section is included below. I'm running
> couch version 1.2.0 on an Amazon EC2 instance running Ubuntu 12.04.1.
>
> It took about a day for this issue to get noticed and during that time the
> server basically ran out of disk space:
>
> Filesystem      Size  Used Avail Use% Mounted on
> /dev/xvda1      8.0G  7.6G     0 100% /
>
> And creating small files is possible but creating large ones fails. It seems
> possible that the disk filled around the time of the the couch crash because
> the end of the log file does seem to be truncated (the last thing I see is
> the "{summary, [" and "<<128,0,0,154>>," lines which seem to have been cut
> off before the closing braces).
>
> Also after the crash happened couch didn't seem to actually shutdown, as I
> could still see the couchdb erlang process running and couch seemed to be
> stuck in a state where no clients could connect to it. After I stopped couch
> and cleared off the drive and then restarted the machine clients could
> connect to it again and all seemed fine.
>
> However, it's not obvious to me from the log / shutdown report that this was
> related to disk space at all. Should I expect couch to log a warning in a
> low disk space situation? Should this situation be recoverable? Can anyone
> from the list help shed some light on what happened here?
>
> Thanks,
> Mark

Hard to say from here what happened. Compaction and view creation are
2 activities that can use a fair bit of disk space, but the excerpt
from the logs has nothing.

Any other info on what was going on at the time?

A+
Dave

Mime
View raw message