Return-Path: X-Original-To: apmail-hadoop-hdfs-dev-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 69DC1D5AA for ; Fri, 24 Aug 2012 22:33:58 +0000 (UTC) Received: (qmail 2084 invoked by uid 500); 24 Aug 2012 22:33:57 -0000 Delivered-To: apmail-hadoop-hdfs-dev-archive@hadoop.apache.org Received: (qmail 1972 invoked by uid 500); 24 Aug 2012 22:33:57 -0000 Mailing-List: contact hdfs-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-dev@hadoop.apache.org Delivered-To: mailing list hdfs-dev@hadoop.apache.org Received: (qmail 1960 invoked by uid 99); 24 Aug 2012 22:33:57 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 Aug 2012 22:33:57 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of sqlxweiwei@gmail.com designates 209.85.160.48 as permitted sender) Received: from [209.85.160.48] (HELO mail-pb0-f48.google.com) (209.85.160.48) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 Aug 2012 22:33:50 +0000 Received: by pbbrq13 with SMTP id rq13so5069321pbb.35 for ; Fri, 24 Aug 2012 15:33:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=bFSad72nY+9IDx0O7QKB7l2FF/cn4MBcpAGw9PBmhEg=; b=c2wAuyN60F82ZeiH/QsuzpntIllA5YKv7xHL5giKIEGphOqufH9f7rlydpTKkongor U79QW6I0pkcO8x84eDUtnErVLAI6b35ZtOBcpGtVJCL073nUVi7IPwiQLepIUYR4ajOL 16Yb+X2C/DcrFwuQvnqnKsM/j1BLcWVyABhNcRBi68zz94H8yZ4wPDZWGbyXcCgghLnZ LIn21dt0afzxF0mgA8U1h2O16jbMqGu4gD8yPlHlymJizcqKSJZUtf3VkKZqbvTl680i Udntb3lwd3sEegmV/JXHCV9Qh1NzMz/UgvFiW4Wmvo5E3yR9Cuv/CAzLkI+9Ui2KE8Cv szdA== MIME-Version: 1.0 Received: by 10.68.220.201 with SMTP id py9mr16055546pbc.137.1345847610638; Fri, 24 Aug 2012 15:33:30 -0700 (PDT) Received: by 10.68.236.6 with HTTP; Fri, 24 Aug 2012 15:33:30 -0700 (PDT) In-Reply-To: References: Date: Fri, 24 Aug 2012 17:33:30 -0500 Message-ID: Subject: A question about the namenode's decision on the data placement of a new file From: wei xu To: hdfs-dev@hadoop.apache.org Content-Type: multipart/alternative; boundary=047d7b2ed951c1007c04c80a9083 X-Virus-Checked: Checked by ClamAV on apache.org --047d7b2ed951c1007c04c80a9083 Content-Type: text/plain; charset=ISO-8859-1 Hi, I am doing some research on the data placement, but I am not quite familiar with the Hadoop, is there any one who can tell me when a new file be added into the HDFS, which function will be called by namenode to make a decision on the allocation ( I mean, if there has a list of datanodes and the file might be larger than 64MB, that is, several blocks may be included. What's the function that decide the placement of those blocks to those datanode?) Thanks for any help you provided! --047d7b2ed951c1007c04c80a9083--