Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D434DE558 for ; Sun, 20 Jan 2013 13:05:18 +0000 (UTC) Received: (qmail 3588 invoked by uid 500); 20 Jan 2013 13:05:14 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 3480 invoked by uid 500); 20 Jan 2013 13:05:13 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 3451 invoked by uid 99); 20 Jan 2013 13:05:13 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 20 Jan 2013 13:05:13 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of harsh@cloudera.com designates 209.85.223.170 as permitted sender) Received: from [209.85.223.170] (HELO mail-ie0-f170.google.com) (209.85.223.170) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 20 Jan 2013 13:05:07 +0000 Received: by mail-ie0-f170.google.com with SMTP id k10so8501111iea.1 for ; Sun, 20 Jan 2013 05:04:46 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=x-received:mime-version:in-reply-to:references:from:date:message-id :subject:to:content-type:x-gm-message-state; bh=vtUKDs6Y/dcx2HWm1nIyBfn4owOu0HZCwGBdQ59IOXg=; b=JmWgkMpMfAjZj8veWvuEf5FUKV2jEKCkEbTjKd2J8tAE+NawaPnLDzdzrKeM09/Net WSnhXO5TUL+5scEryupxhXZZAUt+XQ+dg+Qj+s/HwGlht2lBw9XyrIU+8oF2hlItUpIi XktvN/AZlDYp49GmFVyU4Z0kv6uWVTlacaMgDUmS7LlQfT0+DfagMERuwA4HO2C9h8DF Vf7G44ebrvb6PFTFAkBt89lS2Bf4fxoEkRQqH1chke2MoJ122sr2Y6tD95x29DbCEICh 2saahdvnXKAAoey2s+xFMgny07A5UzGuGVtdqaLwbNUGq/3PYUrT6nhxuUwANl/i6FPI uMGA== X-Received: by 10.50.57.234 with SMTP id l10mr6732024igq.18.1358687086024; Sun, 20 Jan 2013 05:04:46 -0800 (PST) MIME-Version: 1.0 Received: by 10.64.32.166 with HTTP; Sun, 20 Jan 2013 05:04:25 -0800 (PST) In-Reply-To: References: From: Harsh J Date: Sun, 20 Jan 2013 18:34:25 +0530 Message-ID: Subject: Re: Prolonged safemode To: "" Content-Type: multipart/alternative; boundary=14dae93411171f978d04d3b7fdc2 X-Gm-Message-State: ALoCoQkPAyOzTjoT3bRLBLRfjiPwjAkr/JPvMO5194QKY6wzux1bwTnzTJ2Zh1sUOK0zGuAe7JVe X-Virus-Checked: Checked by ClamAV on apache.org --14dae93411171f978d04d3b7fdc2 Content-Type: text/plain; charset=ISO-8859-1 I am not aware of a direct regression in DN startup slowdown or block report slowdown; its hard to tell what exactly the regression is without more notes or logs on behavior. On Sun, Jan 20, 2013 at 5:43 PM, Mohammad Tariq wrote: > Thank you so much for the valuable reply Harsh. I'll > look into it. One quick question, why it it happening > with 1.0.4? Is there any compulsion to set these two > props, you have specified above. Earlier version were > doing absolutely fine without these props? > > I am Sorry to be a pest of questions. But, I am kinda > curious about this. Thank you so much. > > Warm Regards, > Tariq > https://mtariq.jux.com/ > cloudfront.blogspot.com > > > On Sun, Jan 20, 2013 at 4:29 PM, Harsh J wrote: > >> If your DN is starting too slow, then you should investigate why. >> >> In any case, Apache Bigtop's (http://bigtop.apache.org) >> pseudo-distributed configs provide good values for 1-node setups. In your >> case, you seem to be missing dfs.safemode.min.datanodes set to 1, >> and dfs.safemode.extension set to 0. >> >> >> On Sun, Jan 20, 2013 at 4:05 AM, Mohammad Tariq wrote: >> >>> Hello list, >>> >>> I have a pseudo distributed setup on my laptop. Everything was >>> working fine untill now. But lately HDFS has started taking a lot of time >>> to leave the safemode. Infact, I have to it manuaaly most of the times as >>> TT and Hbase daemons get disturbed because of this. >>> >>> I am using hadoop-1.0.4. Is it a problem with this version? I have never >>> faced any such issue with older versions. Or, is something going wrong on >>> my side?? >>> >>> Thank you so much for your precious time. >>> >>> Warm Regards, >>> Tariq >>> https://mtariq.jux.com/ >>> cloudfront.blogspot.com >>> >> >> >> >> -- >> Harsh J >> > > -- Harsh J --14dae93411171f978d04d3b7fdc2 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
I am not aware of a direct regression in DN startup slowdo= wn or block report slowdown; its hard to tell what exactly the regression i= s without more notes or logs on behavior.
<= br>
On Sun, Jan 20, 2013 at 5:43 PM, Mohammad Ta= riq <dontariq@gmail.com> wrote:
Thank you so much for the valuable reply Harsh. I'lllook into it. One quick question, why it it happening
with 1.0= .4? Is there any compulsion to set these two
props, you have spec= ified above. Earlier version were
doing absolutely fine without these props?

I = am Sorry to be a pest of questions. But, I am kinda=A0
curious=A0= about this. Thank you so much.

Warm Regards,
Tariq
<= a href=3D"https://mtariq.jux.com/" target=3D"_blank">https://mtariq.jux.com= /


On Sun, Jan= 20, 2013 at 4:29 PM, Harsh J <harsh@cloudera.com> wrote:
If your DN is starting too slow, then you should investiga= te why.

In any case, Apache Bigtop's (http://bigtop.apache.org) pseu= do-distributed configs provide good values for 1-node setups. In your case,= you seem to be missing=A0dfs.safemode.min.datanodes set to 1, and=A0dfs.sa= femode.extension set to 0.


On Sun, Jan 20, 2013 at 4:05 AM, Mohammad Tariq <dontariq@gmail.com> wrote:
Hello list,

<= div>=A0 =A0 =A0 =A0I have a pseudo distributed setup on my laptop. Everythi= ng was working fine untill now. But lately HDFS has started taking a lot of= time to leave the safemode. Infact, I have to it manuaaly most of the time= s as TT and Hbase daemons get disturbed because of this.=A0

I am using hadoop-1.0.4. Is it a problem with this vers= ion? I have never faced any such issue with older versions. Or, is somethin= g going wrong on my side??

Thank you so much for your precious time.



<= font color=3D"#888888">--
Harsh J




--
Harsh J --14dae93411171f978d04d3b7fdc2--