Return-Path: Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: (qmail 5177 invoked from network); 19 Jan 2010 07:09:44 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 19 Jan 2010 07:09:44 -0000 Received: (qmail 55645 invoked by uid 500); 19 Jan 2010 07:09:41 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 55570 invoked by uid 500); 19 Jan 2010 07:09:41 -0000 Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-user@hadoop.apache.org Delivered-To: mailing list common-user@hadoop.apache.org Received: (qmail 55560 invoked by uid 99); 19 Jan 2010 07:09:41 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 19 Jan 2010 07:09:41 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of prasen.bea@gmail.com designates 209.85.216.204 as permitted sender) Received: from [209.85.216.204] (HELO mail-px0-f204.google.com) (209.85.216.204) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 19 Jan 2010 07:09:35 +0000 Received: by pxi42 with SMTP id 42so4528243pxi.5 for ; Mon, 18 Jan 2010 23:09:14 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:sender:received:in-reply-to :references:date:x-google-sender-auth:message-id:subject:from:to :content-type:content-transfer-encoding; bh=Hc1B9nN8GkiBsn2xfNxX40iTJbxxxAP8oMZpT69WjVw=; b=xt7ux0MoZcTWpI8x25jGc5fR9ddusErg6Ayrpt3UiqJqaVZIK97mpqdaPIiFPsKx3x +izTU47GLNrZUPv8+qGv+INnOxSs6khyar8rQ1Sf+IO75YGfu1q2k9BdmLM+JjlQOnaA VrozB68b67H8YfF4Liz0smd1uWbsgYlYnH8tM= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:content-type :content-transfer-encoding; b=C0+xv5FnGMGD6ycQBg0cy5l3CUXwQna+MqO5oQhMvnNK5bc/YNvVlIrzSCK0gCCgO2 TgpVRU1KeuMhvatuxOcAYTXomlcLi8mWt8/0JigGjZ9Rt/uKDXwLx/Oew9K1DVKbFc13 gWNMZEOVUvQU4EbU5/VA/phUvVum/e/ixwswk= MIME-Version: 1.0 Sender: prasen.bea@gmail.com Received: by 10.114.4.11 with SMTP id 11mr4938174wad.2.1263884954779; Mon, 18 Jan 2010 23:09:14 -0800 (PST) In-Reply-To: <944750dd1001182254j2f66e37dp445089032c062fb4@mail.gmail.com> References: <500e4a1e1001182101m90a05er111427f26d8404fa@mail.gmail.com> <500e4a1e1001182246l4dce739j68ed414d90b5f76@mail.gmail.com> <944750dd1001182254j2f66e37dp445089032c062fb4@mail.gmail.com> Date: Tue, 19 Jan 2010 12:39:14 +0530 X-Google-Sender-Auth: 83360e102d6e666e Message-ID: <500e4a1e1001182309i3c81dac2y919b47bfa39ad3e8@mail.gmail.com> Subject: Re: rmr: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot delete /op. Name node is in safe mode. From: prasenjit mukherjee To: common-user@hadoop.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable That was exactly the reason. Thanks a bunch. On Tue, Jan 19, 2010 at 12:24 PM, Mafish Liu wrote: > 2010/1/19 prasenjit mukherjee : >> =A0I run "hadoop fs -rmr .." immediately after start-all.sh =A0 =A0Does = the >> namenode always start in safemode and after sometime switches to >> normal mode ? If that is the problem then your suggestion of waiting >> might work. Lemme check. > > This is the point. Namenode will enter safemode on starting to gather > metadata information of files, and then switch to normal mode. The > time spent in safemode depends one the data scale in your HDFS. >> >> -Thanks for the pointer. >> Prasen >> >> On Tue, Jan 19, 2010 at 10:47 AM, Amogh Vasekar wr= ote: >>> Hi, >>> When NN is in safe mode, you get a read-only view of the hadoop file sy= stem. ( since NN is reconstructing its image of FS ) >>> Use =A0"hadoop dfsadmin -safemode get" to check if in safe mode. >>> "hadoop dfsadmin -safemode leave" to leave safe mode forcefully. Or use= "hadoop dfsadmin -safemode wait" to block till NN leaves by itself. >>> >>> Amogh >>> >>> >>> On 1/19/10 10:31 AM, "prasenjit mukherjee" wrote= : >>> >>> Hmmm. =A0I am actually running it from a batch file. Is "hadoop fs -rmr= " >>> not that stable compared to pig's rm OR hadoop's FileSystem ? >>> >>> Let me try your suggestion by writing a cleanup script in pig. >>> >>> -Thanks, >>> Prasen >>> >>> On Tue, Jan 19, 2010 at 10:25 AM, Rekha Joshi = wrote: >>>> Can you try with dfs/ without quotes?If using pig to run jobs you can = use rmf within your script(again w/o quotes) to force remove and avoid erro= r if file/dir not present.Or if doing this inside hadoop job, you can use F= ileSystem/FileStatus to delete directories.HTH. >>>> Cheers, >>>> /R >>>> >>>> On 1/19/10 10:15 AM, "prasenjit mukherjee" wrot= e: >>>> >>>> "hadoop fs -rmr /op" >>>> >>>> That command always fails. I am trying to run sequential hadoop jobs. >>>> After the first run all subsequent runs fail while cleaning up ( aka >>>> removing the hadoop dir created by previous run ). What can I do to >>>> avoid this ? >>>> >>>> here is my hadoop version : >>>> # hadoop version >>>> Hadoop 0.20.0 >>>> Subversion https://svn.apache.org/repos/asf/hadoop/core/branches/branc= h-0.20 >>>> -r 763504 >>>> Compiled by ndaley on Thu Apr =A09 05:18:40 UTC 2009 >>>> >>>> Any help is greatly appreciated. >>>> >>>> -Prasen >>>> >>>> >>> >>> >> > > > > -- > Mafish@gmail.com >