Return-Path: Delivered-To: apmail-hadoop-core-user-archive@www.apache.org Received: (qmail 78371 invoked from network); 10 Aug 2008 05:49:17 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 10 Aug 2008 05:49:17 -0000 Received: (qmail 3271 invoked by uid 500); 10 Aug 2008 05:49:11 -0000 Delivered-To: apmail-hadoop-core-user-archive@hadoop.apache.org Received: (qmail 3237 invoked by uid 500); 10 Aug 2008 05:49:11 -0000 Mailing-List: contact core-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-user@hadoop.apache.org Delivered-To: mailing list core-user@hadoop.apache.org Received: (qmail 3226 invoked by uid 99); 10 Aug 2008 05:49:11 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 09 Aug 2008 22:49:11 -0700 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of dhruba@gmail.com designates 209.85.128.189 as permitted sender) Received: from [209.85.128.189] (HELO fk-out-0910.google.com) (209.85.128.189) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 10 Aug 2008 05:48:08 +0000 Received: by fk-out-0910.google.com with SMTP id 26so1277435fkx.13 for ; Sat, 09 Aug 2008 22:48:18 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:cc:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=B0wki7G5gvN/nuKBz+ntgjY5ylFqFZ0lsph+ZN4gD6s=; b=dN9NtClw6YTT9sqSH/YGdsclKLuGBb3NdJTNYXRmvVC7GsaJlMg0ncaf2T7z2TpQop 4Z7GXq01pGdhgyS8Eihhd3Oy8BIXt58Y188ruxbtSPt+17lX8gd4zmmjrFWfzzFRncoj asXHuq7cFms1ebV2dt+yV6x2WevQpw5u+Wy3U= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=WRa3iHcDpEtUQrt6kEHzCUaRmkpQH4NdSJ9v0igQE3zyxe7XpIb/EoMpGHRZlPTZtC pkVzPgQyFFw43LcnQmtEPwJF5vVejP8EjRKCcK8DM/lajpByf8XxP4relfw3EpLjP+qy /rWJ5OV3MvDlmrQuKoVF8fa5QH8HQdfH3YAbs= Received: by 10.180.220.5 with SMTP id s5mr3074745bkg.5.1218347297789; Sat, 09 Aug 2008 22:48:17 -0700 (PDT) Received: by 10.125.88.16 with HTTP; Sat, 9 Aug 2008 22:48:17 -0700 (PDT) Message-ID: <4aa34eb70808092248m1cbd941cg16057e50f17895a5@mail.gmail.com> Date: Sat, 9 Aug 2008 21:48:17 -0800 From: "Dhruba Borthakur" To: core-user@hadoop.apache.org Subject: Re: What will happen if two processes writes the same HDFS file Cc: hadoop-user@lucene.apache.org In-Reply-To: <4751f7df0808092130h56afd5ffx5a67616bafb14d7@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <4751f7df0808092130h56afd5ffx5a67616bafb14d7@mail.gmail.com> X-Virus-Checked: Checked by ClamAV on apache.org When the first one contacts the namenode to open the file for writing, the namenode records this info in a "lease". When the second process contacts the namenode to open the same file for writing, the namenode sees that a "lease" already exists for the file and rejects the request from the second process. On Sat, Aug 9, 2008 at 8:30 PM, 11 Nov. wrote: > IMHO, there must be one process that fails the write. >