Return-Path: Delivered-To: apmail-hadoop-mapreduce-dev-archive@minotaur.apache.org Received: (qmail 13326 invoked from network); 1 Dec 2009 03:12:00 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 1 Dec 2009 03:12:00 -0000 Received: (qmail 98137 invoked by uid 500); 1 Dec 2009 03:11:59 -0000 Delivered-To: apmail-hadoop-mapreduce-dev-archive@hadoop.apache.org Received: (qmail 98047 invoked by uid 500); 1 Dec 2009 03:11:59 -0000 Mailing-List: contact mapreduce-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-dev@hadoop.apache.org Delivered-To: mailing list mapreduce-dev@hadoop.apache.org Received: (qmail 98037 invoked by uid 99); 1 Dec 2009 03:11:59 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 01 Dec 2009 03:11:59 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of zs68j2ee@gmail.com designates 209.85.216.201 as permitted sender) Received: from [209.85.216.201] (HELO mail-px0-f201.google.com) (209.85.216.201) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 01 Dec 2009 03:11:51 +0000 Received: by pxi39 with SMTP id 39so3439420pxi.2 for ; Mon, 30 Nov 2009 19:11:29 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:content-type :content-transfer-encoding; bh=7GDcmM2i/kX16uxZIiAN8Em2nAilQErNIRq9ietbzpo=; b=VyDdUK/Qp/HK+T5ufZr41iTFils5wcpfMVBZIV1G5TVcPFHBNzanTnO+VvdgqYRaP9 ybfXLG919Z1mxRV9oMFh4TxG+Y5Gf3RT8kxnlgyA54dIWZdh9SVIhoPdIbByn0KOiLZ7 Yqt+yiiGgMmJXVUwjHmdEfQyIoUF6V3btMgMk= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; b=xFCzZMtF+0Aftz3jYbKoSdvZM3STlg9aNN7Pa/Emhb1nkx9ZsQAyWjjym3E/Tt6yRK QRi3EzWeLxbENwjkiqQ0dCQ84yewGVTFJyraz5me58stlDVFS5AGiT/TkBAfxLSvJPj2 XxxFFl+yVhCoxdpkU/DZVp0c/5y8Ai/J6yboE= MIME-Version: 1.0 Received: by 10.140.172.20 with SMTP id u20mr310975rve.23.1259637089826; Mon, 30 Nov 2009 19:11:29 -0800 (PST) In-Reply-To: <350526412.1259636849801.JavaMail.jira@brutus> References: <350526412.1259636849801.JavaMail.jira@brutus> Date: Tue, 1 Dec 2009 11:11:29 +0800 Message-ID: Subject: Re: [jira] Created: (MAPREDUCE-1254) job.xml should add crc check in tasktracker and sub jvm. From: tom To: mapreduce-dev@hadoop.apache.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org unsubscribe 2009/12/1 ZhuGuanyin (JIRA) : > job.xml should add crc check in tasktracker and sub jvm. > -------------------------------------------------------- > > =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 Key: MAPREDUCE-12= 54 > =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 URL: https://issu= es.apache.org/jira/browse/MAPREDUCE-1254 > =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 Project: Hadoop Map/Reduce > =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Issue Type: New Feature > =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Components: task, tasktracker > =C2=A0 =C2=A0Affects Versions: 0.22.0 > =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Reporter: ZhuGuanyin > > > Currently job.xml in tasktracker and subjvm are write to local disk throu= gh ChecksumFilesystem, and already had crc checksum information, but load t= he job.xml file without crc check. It would cause the mapred job finished s= uccessful but with wrong data because of disk error. =C2=A0Example: The tas= ktracker and sub task jvm would load the default configuration if it doesn'= t successfully load the job.xml which maybe replace the mapper with Identit= yMapper. > > -- > This message is automatically generated by JIRA. > - > You can reply to this email to add a comment to the issue online. > >