Return-Path: Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: (qmail 18244 invoked from network); 21 Feb 2011 12:19:14 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 21 Feb 2011 12:19:14 -0000 Received: (qmail 18031 invoked by uid 500); 21 Feb 2011 12:19:12 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 17948 invoked by uid 500); 21 Feb 2011 12:19:08 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 17940 invoked by uid 99); 21 Feb 2011 12:19:07 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 21 Feb 2011 12:19:07 +0000 X-ASF-Spam-Status: No, hits=-0.1 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [85.158.137.35] (HELO mail134.messagelabs.com) (85.158.137.35) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 21 Feb 2011 12:18:59 +0000 X-VirusChecked: Checked X-Env-Sender: daniel.josefsson@shazamteam.com X-Msg-Ref: server-6.tower-134.messagelabs.com!1298290718!17405932!2 X-StarScan-Version: 6.2.9; banners=shazamteam.com,-,- X-Originating-IP: [217.28.130.38] Received: (qmail 13594 invoked from network); 21 Feb 2011 12:18:38 -0000 Received: from hostedexchange.hostedservice.com (HELO outlook.hostedservice2.net) (217.28.130.38) by server-6.tower-134.messagelabs.com with RC4-SHA encrypted SMTP; 21 Feb 2011 12:18:38 -0000 Received: from [192.168.195.7] (217.111.143.154) by smtp.hostedservice2.net (192.168.16.124) with Microsoft SMTP Server (TLS) id 8.2.254.0; Mon, 21 Feb 2011 11:39:31 +0000 Subject: Re: java.io.IOException in CompactionExecutor From: Daniel Josefsson To: "user@cassandra.apache.org" In-Reply-To: References: Content-Type: multipart/alternative; boundary="=-zSXMpWG9uvXljtkkp96d" Date: Mon, 21 Feb 2011 11:39:24 +0000 Message-ID: <1298288364.6383.17.camel@danielj-OptiPlex-780> MIME-Version: 1.0 X-Mailer: Evolution 2.30.3 X-Virus-Checked: Checked by ClamAV on apache.org --=-zSXMpWG9uvXljtkkp96d Content-Type: text/plain; charset="ISO-8859-1" Content-Transfer-Encoding: 7bit There is no antivirus program or similar running on that machine I guess? That could definitely lock the file if Cassandra is creating the .tmp file and then fairly shortly after tries to rename it. /Daniel On Mon, 2011-02-21 at 11:34 +0000, Aaron Morton wrote: > The code creates a new .tmp file in the saved_caches directory and > then renames it to a non .tmp file name, so there is nothing else with > a handle open. The rename is to an existing file though. > > > Ruslan can you please raise a bug against 0.7.2 for this and include > the platform. > > > Thanks > Aaron > > > On 22 Feb, 2011,at 12:22 AM, Norman Maurer wrote: > > > > The "problem" on windows is that it is a bit more worried about > > rename > > a file if the handle is still open. > > > > So maybe some stream not closed on the file. > > > > Bye, > > Norman > > > > > > 2011/2/21 Aaron Morton : > > > From th F:/ I assume you are on Windows ? What version? > > > Just did a quick test on Ubuntu 10.0.4 and it works, but the > > File.renameTo() > > > function used has different behavior depending on the host OS. > > There may be > > > some issues on > > > > > Window http://stackoverflow.com/questions/1000183/reliable-file-renameto-alternative-on-windows > > > Aaron > > > > > > > > > On 21 Feb, 2011,at 11:43 PM, ruslan usifov > > wrote: > > > > > > I launch clean cassandra 7.2 instalation, and after few days i > > look at > > > system.log follow error (more then 10 time): > > > > > > > > > ERROR [CompactionExecutor:1] 2011-02-19 02:56:17,965 > > > AbstractCassandraDaemon.java (line 114) Fatal exception in thread > > > Thread[CompactionExecutor:1,1,main] > > > java.lang.RuntimeException: java.io.IOException: Unable to rename > > cache to > > > F:\Cassandra\7.2\saved_caches\system-LocationInfo-KeyCache > > > at > > > > > org.apache.cassandra.utils.WrappedRunnablerun(WrappedRunnable.java:34) > > > at > > > java.util.concurrent.Executors > > $RunnableAdapter.call(Executors.java:441) > > > at java.util.concurrent.FutureTask > > $Sync.innerRun(FutureTask.java:303) > > > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > > > at > > > java.util.concurrent.ThreadPoolExecutor > > $Worker.runTask(ThreadPoolExecutor.java:886) > > > at > > > java.util.concurrent.ThreadPoolExecutor > > $Worker.run(ThreadPoolExecutor.java:908) > > > at java.lang.Thread.run(Thread.java:662) > > > Caused by: java.io.IOException: Unable to rename cache to > > > F:\Cassandra\7.2\saved_caches\system-LocationInfo-KeyCache > > > at > > > > > org.apache.cassandra.io.sstable.CacheWriter.saveCache(CacheWriter.java:85) > > > at > > > org.apache.cassandra.db.CompactionManager > > $9.runMayThrow(CompactionManager.java:746) > > > at > > > > > org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30) > > > ... 6 more > > > > > > > > -- Daniel Josefsson Software Engineer Shazam Entertainment Ltd 26-28 Hammersmith Grove, London W6 7HA w: www.shazam.com Please consider the environment before printing this document This e-mail and its contents are strictly private and confidential. It must not be disclosed, distributed or copied without our prior consent. If you have received this transmission in error, please notify Shazam Entertainment immediately on: +44 (0) 020 8742 6820 and then delete it from your system. Please note that the information contained herein shall additionally constitute Confidential Information for the purposes of any NDA between the recipient/s and Shazam Entertainment. Shazam Entertainment Limited is incorporated in England and Wales under company number 3998831 and its registered office is at 26-28 Hammersmith Grove, London W6 7HA. ______________________________________________________________________ This email has been scanned by the MessageLabs Email Security System. For more information please visit http://www.messagelabs.com/email ______________________________________________________________________ --=-zSXMpWG9uvXljtkkp96d Content-Type: text/html; charset="utf-8" Content-Transfer-Encoding: 7bit There is no antivirus program or similar running on that machine I guess?

That could definitely lock the file if Cassandra is creating the .tmp file and then fairly shortly after tries to rename it.

/Daniel

On Mon, 2011-02-21 at 11:34 +0000, Aaron Morton wrote:
The code creates a new .tmp file in the saved_caches directory and then renames it to a non .tmp file name, so there is nothing else with a handle open. The rename is to an existing file though. 


Ruslan can you please raise a bug against 0.7.2 for this and include the platform. 


Thanks
Aaron


On 22 Feb, 2011,at 12:22 AM, Norman Maurer <norman@apache.org> wrote:


The "problem" on windows is that it is a bit more worried about rename
a file if the handle is still open.

So maybe some stream not closed on the file.

Bye,
Norman


2011/2/21 Aaron Morton <aaron@thelastpickle.com>:
> From th F:/ I assume you are on Windows ? What version?
> Just did a quick test on Ubuntu 10.0.4 and it works, but the File.renameTo()
> function used has different behavior depending on the host OS. There may be
> some issues on
> Window http://stackoverflow.com/questions/1000183/reliable-file-renameto-alternative-on-windows
> Aaron
>
>
> On 21 Feb, 2011,at 11:43 PM, ruslan usifov <ruslan.usifov@gmail.com> wrote:
>
> I launch clean cassandra 7.2 instalation, and after few days i look at
> system.log follow error (more then 10 time):
>
>
> ERROR [CompactionExecutor:1] 2011-02-19 02:56:17,965
> AbstractCassandraDaemon.java (line 114) Fatal exception in thread
> Thread[CompactionExecutor:1,1,main]
> java.lang.RuntimeException: java.io.IOException: Unable to rename cache to
> F:\Cassandra\7.2\saved_caches\system-LocationInfo-KeyCache
>     at
> org.apache.cassandra.utils.WrappedRunnablerun(WrappedRunnable.java:34)
>     at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
>     at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
>     at java.util.concurrent.FutureTask.run(FutureTask.java:138)
>     at
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
>     at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
>     at java.lang.Thread.run(Thread.java:662)
> Caused by: java.io.IOException: Unable to rename cache to
> F:\Cassandra\7.2\saved_caches\system-LocationInfo-KeyCache
>     at
> org.apache.cassandra.io.sstable.CacheWriter.saveCache(CacheWriter.java:85)
>     at
> org.apache.cassandra.db.CompactionManager$9.runMayThrow(CompactionManager.java:746)
>     at
> org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30)
>     ... 6 more
>
>


--


Daniel Josefsson

Software Engineer

Shazam Entertainment Ltd    
26-28 Hammersmith Grove, London W6 7HA
w:         www.shazam.com

Please consider the environment before printing this document

This e-mail and its contents are strictly private and confidential. It must not be disclosed, distributed or copied without our prior consent. If you have received this transmission in error, please notify Shazam Entertainment immediately on: +44 (0) 020 8742 6820 and then delete it from your system. Please note that the information contained herein shall additionally constitute Confidential Information for the purposes of any NDA between the recipient/s and Shazam Entertainment. Shazam Entertainment Limited is incorporated in England and Wales under company number 3998831 and its registered office is at 26-28 Hammersmith Grove, London W6 7HA. 



______________________________________________________________________
This email has been scanned by the MessageLabs Email Security System.
For more information please visit http://www.messagelabs.com/email
______________________________________________________________________
--=-zSXMpWG9uvXljtkkp96d--