Mailing-List: contact hadoop-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hadoop-user@lucene.apache.org
Received-SPF: pass (athena.apache.org: local policy)
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws;
  s=s1024; d=yahoo.com;
  h=X-YMail-OSG:Received:Date:From:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding:Message-ID;
  b=KpYDPI39I50/A0rrrHK7K61EjPtijol7puMtU/c9VtSx2sy7ZZ53nziUnPaFvyVh6L5l8lRBNYvcIuhKB80GgDAw3D4iRODXpCoWV9h4QkHCyKxiUYOXR7/gB4kTf8thEU5PyQPziYCBgRlDlQKW+HGld/zw1fbi6Dtxzj4yD9U=;
Date: Sat, 24 Nov 2007 18:38:19 -0800 (PST)
From: C G <parallelguy@yahoo.com>
Subject: RE: Hanging shell commands question, and strange delays in processing
To: hadoop-user@lucene.apache.org
In-Reply-To: 
 <84E52AD05F6F884AAFF3344FE4C959917A720B@SNV-EXVS08.ds.corp.yahoo.com>
MIME-Version: 1.0
Content-Type: multipart/alternative; boundary="0-876499225-1195958299=:77054"
Content-Transfer-Encoding: 8bit
Message-ID: <962394.77054.qm@web45411.mail.sp1.yahoo.com>

--0-876499225-1195958299=:77054
Content-Type: text/plain; charset=iso-8859-1
Content-Transfer-Encoding: 8bit

Hi Dhruba:
   
  I'll run some tests in isolation and try to get these logs for you.  I saw a hang like this last night in some testing and I decided to let it run.  About 3 hours later it finally completed...this still seems out-of-spec.  I'll try to get some clean logs for you and send them along.
   
  Thanks,
  C G

dhruba Borthakur <dhruba@yahoo-inc.com> wrote:
  Hi CG,

When the shell hangs, can you pl get the following:

1. The namenode log file
2. The namenode stack dump. This can be generated by running the command
"jstack ". You will typically find the jstack
utility in the same directory where the "java" binary is installed.

Thanks,
dhruba


1. Hanging shell commands: Our system is all script-driven. The
first thing our main driver does when it starts up is delete old
datasets in preparation for creating new ones. A command like this will
hang forever about 5% of the time:

bin/hadoop dfs -rmr /import/data/20071030


---------------------------------
Get easy, one-click access to your favorites.  Make Yahoo! your homepage.
--0-876499225-1195958299=:77054--