Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B23726BD3 for ; Thu, 30 Jun 2011 19:37:16 +0000 (UTC) Received: (qmail 86731 invoked by uid 500); 30 Jun 2011 19:37:15 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 86682 invoked by uid 500); 30 Jun 2011 19:37:15 -0000 Mailing-List: contact mapreduce-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-user@hadoop.apache.org Delivered-To: mailing list mapreduce-user@hadoop.apache.org Received: (qmail 86674 invoked by uid 99); 30 Jun 2011 19:37:15 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 30 Jun 2011 19:37:15 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of ginzman@hotmail.com designates 65.55.90.28 as permitted sender) Received: from [65.55.90.28] (HELO snt0-omc1-s17.snt0.hotmail.com) (65.55.90.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 30 Jun 2011 19:37:06 +0000 Received: from SNT135-W43 ([65.55.90.8]) by snt0-omc1-s17.snt0.hotmail.com with Microsoft SMTPSVC(6.0.3790.4675); Thu, 30 Jun 2011 12:36:46 -0700 Message-ID: Content-Type: multipart/alternative; boundary="_9b6f7ceb-b18a-4ae4-9402-cd72454990f3_" X-Originating-IP: [94.159.200.1] From: David Ginzburg To: Subject: RE: Dead data nodes during job excution and failed tasks. Date: Thu, 30 Jun 2011 19:36:46 +0000 Importance: Normal In-Reply-To: <6D175060-691A-4B17-BBDC-C1BE9B872101@apache.org> References: ,<6D175060-691A-4B17-BBDC-C1BE9B872101@apache.org> MIME-Version: 1.0 X-OriginalArrivalTime: 30 Jun 2011 19:36:46.0557 (UTC) FILETIME=[0C5958D0:01CC375D] --_9b6f7ceb-b18a-4ae4-9402-cd72454990f3_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Is it possible though the server runs with vm.swappiness =3D5 > Subject: Re: Dead data nodes during job excution and failed tasks. > From: aw@apache.org > Date: Thu=2C 30 Jun 2011 11:46:25 -0700 > To: mapreduce-user@hadoop.apache.org >=20 >=20 > On Jun 30=2C 2011=2C at 10:01 AM=2C David Ginzburg wrote: >=20 > >=20 > > Hi=2C > > I am running a certain job which constantly cause dead data nodes (who = come back later=2C spontaneously ). >=20 > Check your memory usage during the job run. Chances are good the DataNo= de is getting swapped out. = --_9b6f7ceb-b18a-4ae4-9402-cd72454990f3_ Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable
Is it possible though the server runs with vm.swappiness =3D5

<=
br>

>=3B Subject: Re: Dead data nodes during job excution a= nd failed tasks.
>=3B From: aw@apache.org
>=3B Date: Thu=2C 30 Ju= n 2011 11:46:25 -0700
>=3B To: mapreduce-user@hadoop.apache.org
>= =3B
>=3B
>=3B On Jun 30=2C 2011=2C at 10:01 AM=2C David Ginzbur= g wrote:
>=3B
>=3B >=3B
>=3B >=3B Hi=2C
>=3B >= =3B I am running a certain job which constantly cause dead data nodes (who = come back later=2C spontaneously ).
>=3B
>=3B Check your memory= usage during the job run. Chances are good the DataNode is getting swappe= d out.
= --_9b6f7ceb-b18a-4ae4-9402-cd72454990f3_--