Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of jason.rutherglen@gmail.com
 designates 209.85.216.169 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type;
        b=vx6IPY1/+NZzJ2RKYny4jIHff+hJU7t5kja/hzcR4A6fWiu0M2ATvlk0KtJAWymnPi
         a0XyGZpYU9SYy/3MYB0oZsikVf51VUSJfhVH1vZ16I2jEGJcDPGt0b9eBKPtKj5+pmhT
         4Di+895FWq6IidW9InuVtiB8iS6ED+Frzomc0=
MIME-Version: 1.0
In-Reply-To: <BANLkTi=7mGQwvQjbLm+4wx3Kupc0s0rOXA@mail.gmail.com>
References: <BANLkTi=7mGQwvQjbLm+4wx3Kupc0s0rOXA@mail.gmail.com>
Date: Mon, 11 Apr 2011 16:05:37 -0700
Message-ID: <BANLkTi=ZwbgkejiD0SV0rmK51wa+R3BkRg@mail.gmail.com>
Subject: Re: Memory mapped resources
From: Jason Rutherglen <jason.rutherglen@gmail.com>
To: common-user@hadoop.apache.org
Content-Type: text/plain; charset=ISO-8859-1

Yes you can however it will require customization of HDFS.  Take a
look at HDFS-347 specifically the HDFS-347-branch-20-append.txt patch.
 I have been altering it for use with HBASE-3529.  Note that the patch
noted is for the -append branch which is mainly for HBase.

On Mon, Apr 11, 2011 at 3:57 PM, Benson Margulies <bimargulies@gmail.com> wrote:
> We have some very large files that we access via memory mapping in
> Java. Someone's asked us about how to make this conveniently
> deployable in Hadoop. If we tell them to put the files into hdfs, can
> we obtain a File for the underlying file on any given node?
>