Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 63900F509 for ; Fri, 12 Apr 2013 08:31:17 +0000 (UTC) Received: (qmail 68536 invoked by uid 500); 12 Apr 2013 08:31:12 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 68263 invoked by uid 500); 12 Apr 2013 08:31:12 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 68250 invoked by uid 99); 12 Apr 2013 08:31:11 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 12 Apr 2013 08:31:11 +0000 X-ASF-Spam-Status: No, hits=2.9 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [106.10.149.112] (HELO nm19-vm1.bullet.mail.sg3.yahoo.com) (106.10.149.112) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 12 Apr 2013 08:31:03 +0000 Received: from [106.10.166.62] by nm19.bullet.mail.sg3.yahoo.com with NNFMP; 12 Apr 2013 08:30:33 -0000 Received: from [106.10.151.252] by tm19.bullet.mail.sg3.yahoo.com with NNFMP; 12 Apr 2013 08:30:32 -0000 Received: from [127.0.0.1] by omp1001.mail.sg3.yahoo.com with NNFMP; 12 Apr 2013 08:30:32 -0000 X-Yahoo-Newman-Property: ymail-3 X-Yahoo-Newman-Id: 554978.79717.bm@omp1001.mail.sg3.yahoo.com Received: (qmail 13101 invoked by uid 60001); 12 Apr 2013 08:30:32 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.in; s=s1024; t=1365755432; bh=nXsb5Opv+YamZrmsUhbX9q7pP0ELEpiKcZ19J1FNHJE=; h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=0wpMpqFJf6l324sKsAqFYd8l5JBXhEZN5whboh+DuJTFDZKKkjn2ezcbqJ7Mz9L04iUxZTrdX6hfsUqXoXtvORvgDufq9k/SkIOrwWKkoBnqzaDltdfkEVwQmmBPzjfCVI7a1h9Y9NfbbUAssI7SoN+9GvG5NQL4EA3dY9kbx7s= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.in; h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=qx+xkMaj12bYJcblNDJQs6epJsgrKnjBFfMXho6cdPg+6wpi5HJkQjZqIPqhg+w53XwVOHwVmpO3EDuYBxQ863M/S7fBegCehApfg1Ie6FoW/tLCseaAvEKrrS7qYaD9QrBY+00hJDu0mTB3leXlq3uVikwSm0oEBpladjcW/lk=; X-YMail-OSG: fTcKcg8VM1mcpH6jPxTQm4kZs.5Pchmw3vwCo2PBeU2vk7A awD9G4zEEJ9W_Wkc5S7.Q91wAxKsJ2yB4C..UHIcHS7uEGUIGEF62f7tuLkU r8MRh.Jn4LPX1aKyHZhaezJ9fKMsmakh64UokrFSpFbGlgGeG09inwvk_jjq W_IkLl_Uk095QKrHAaQGBgUbXrP2VBaZdIuszqZ9ukrWJgP6FxM4NYYEE2Wh iDloDIkE6nCjaKoU3XdcKzoIu4A9FjY9mykkFgt3T4qm22QHCfTuQ73z0h.r mDSrAH2kMgI462EyZ_tdnJ8_BDtvMtjaoeChg2b8hZnJ_9IR.4Zs.4CRSuyF nBRaFzrpym5u3DqHW.qyoPxvGFsZOP9VP2et_WwYcT1S3TFU.PYVY_mTxDC_ 5ut743lX34evry2LpTcDcNuwogZGTk2sNHpn6bspAjtk- Received: from [49.204.51.39] by web190701.mail.sg3.yahoo.com via HTTP; Fri, 12 Apr 2013 16:30:32 SGT X-Rocket-MIMEInfo: 002.001,QSBmZXcgYmFzaWMgcXVlc3Rpb25zOgoKV2lsbCBIREZTIHJlZmVyIHRvIHRoZSBtZW1vcnkgb2YgTmFtZU5vZGUgJiBEYXRhTm9kZSBvciBpcyBpdCBhIHNlcGFyYXRlIG1hY2hpbmUuCgoKRm9yIE5hbWVOb2RlLCBEYXRhTm9kZSBhbmQgb3RoZXJzIHRoZXJlIGlzIGEgcHJvY2VzcyBhc3NvY2lhdGVkIHdpdGggZWFjaCBvZiBlbS4KQnV0IG5vIHByb2Nlc3MgaXMgZm9yIEhERlMsIHdvbmRlcmluZyB3aHk_IEkgdW5kZXJzdGFuZCB0aGF0IGZzSW1hZ2UgaGFzIHRoZSBtZXRhIGRhdGEgb2YgdGhlIEhERlMsIHMBMAEBAQE- X-Mailer: YahooMailWebService/0.8.140.532 References: <1364377874.13753.YahooMailNeo@web194703.mail.sg3.yahoo.com> <1364577771.12724.YahooMailNeo@web194704.mail.sg3.yahoo.com> <1364719534.91394.YahooMailNeo@web194703.mail.sg3.yahoo.com> <1365042870.89547.YahooMailNeo@web194702.mail.sg3.yahoo.com> <1365740112.75877.YahooMailNeo@web190702.mail.sg3.yahoo.com> <578478094-1365742754-cardhu_decombobulator_blackberry.rim.net-2001349931-@b16.c6.bise7.blackberry> <1365754060.82642.YahooMailNeo@web190701.mail.sg3.yahoo.com> <1365754228.40174.YahooMailNeo@web190705.mail.sg3.yahoo.com> <1365754910.18961.YahooMailNeo@web190702.mail.sg3.yahoo.com> Message-ID: <1365755432.10219.YahooMailNeo@web190701.mail.sg3.yahoo.com> Date: Fri, 12 Apr 2013 16:30:32 +0800 (SGT) From: Sai Sai Reply-To: Sai Sai Subject: Re: Will HDFS refer to the memory of NameNode & DataNode or is it a separate machine To: "user@hadoop.apache.org" In-Reply-To: <1365754910.18961.YahooMailNeo@web190702.mail.sg3.yahoo.com> MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="-1467945103-219256271-1365755432=:10219" X-Virus-Checked: Checked by ClamAV on apache.org ---1467945103-219256271-1365755432=:10219 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable A few basic questions:=0A=0AWill HDFS refer to the memory of NameNode & Dat= aNode or is it a separate machine.=0A=0A=0AFor NameNode, DataNode and other= s there is a process associated with each of em.=0ABut no process is for HD= FS, wondering why? I understand that fsImage has the meta data of the HDFS,= so when NameNode or DataNode or JobTracker/TT needs to get file info will = they just look into the fsImage.=0A=0AWhen we put a file in HDFS is it poss= ible to look/find in which node (NN/DN) it physically sits.=0A=0AAny help i= s appreciated.=0AThanks=0ASai ---1467945103-219256271-1365755432=:10219 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable
A few basic ques= tions:

Will HDFS refer to the memory of Na= meNode & DataNode or is it a separate machine.
For NameNode, DataNode and others there is a process a= ssociated with each of em.
But no process is for= HDFS, wondering why? I understand that fsImage has the meta data of the HD= FS, so when NameNode or DataNode or JobTracker/TT needs to get file info wi= ll they just look into the fsImage.


Any hel= p is appreciated.
Thanks
Sai
---1467945103-219256271-1365755432=:10219--