Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-dev@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of ketan.dixit@gmail.com
 designates 209.85.218.213 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:date:message-id:subject:from:to:content-type;
        b=gtx2LEkCLOv3JBtgUIhifY+iWOeb9r09+J7H7gD8AXMDXO62MAE510NceghSKu8TZr
         I7ymFPWvJVq3v2nzf0yinFS07AQUuMcx3QKNckXLInInWt9v/uNaoRryA1Mm84FbV9Ja
         JMSz1rkiIjhObcIVY6pdODkKm3ZIsgFzPTCt8=
MIME-Version: 1.0
Date: Mon, 1 Mar 2010 11:48:36 -0500
Message-ID: <68432d881003010848m754a03c8vd279e7c9a90890c5@mail.gmail.com>
Subject: Namespace partitioning using Locality Sensitive Hashing
From: Ketan Dixit <ketan.dixit@gmail.com>
To: common-dev@hadoop.apache.org
Content-Type: multipart/alternative; boundary=001517448ad83271050480c0052f

--001517448ad83271050480c0052f
Content-Type: text/plain; charset=ISO-8859-1

Hi,
I am a graduate student in Computer Science department at SUNY Stony Brook.
 I am thinking of doing a project on Hadoop for my course "Cloud Computing"
conducted by Prof. Radu Sion.
While going through the links of the "Yahoo open source projects for
students"  page I found the idea
"Research on new hashing schemes for filesystem namespace partitioning"
interesting. It looks to me the idea is
to assign subtree of the whole namespace to one namenode and another subtree
to another namenode.
How  LSH is better than normal hashing?  Because still, a client or a fixed
namenode has to take decision of which namenode to contact in whatever
hashing ? It looks to me that requests to files under same subtree are
directed to the same namenode then the performance will be faster as the
requests to the same namenode are clustered around the a part of namespace
subtree
(For example a part of on which client is doing some operation.) Is this
assumption correct? Can I have more insight in this regard.


Thanks,
Ketan

--001517448ad83271050480c0052f--