hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From alo alt <wget.n...@googlemail.com>
Subject Re: Best option for mounting HDFS
Date Thu, 08 Dec 2011 11:05:14 GMT
Hi Stuti,

I've set up Lucy LTS to figure out our build-problem earlier today, so I
can also help you there ;)

install the repo:
#> wget
http://archive.cloudera.com/one-click-install/lucid/cdh3-repository_1.0_all.deb&&
dpkg -i cdh3-repository_1.0_all.deb
#> apt-get update
#>apt-cache search hadoop

print me out a list of all packages.

#> apt-get install hadoop-0.20-fuse

install it.

please give a try.

- alex


On Thu, Dec 8, 2011 at 11:09 AM, Stuti Awasthi <stutiawasthi@hcl.com> wrote:

> Hi Alexander,
>
> I want to try with CDH for mount option of HDFS. I have Ubuntu machine. I
> am following : https://ccp.cloudera.com/display/CDHDOC/Mountable+HDFS
> But when I do  “sudo apt-get install hadoop-0.20-fuse”, I am getting error
> of no package found.
> I already have Hadoop running version Hadoop 0.20.2
>
> Are there any more steps before I try to download Hadoop-0.20-fuse package.
>
> Thanks
>
> From: Alexander C.H. Lorenz [mailto:wget.null@googlemail.com]
> Sent: Wednesday, November 30, 2011 2:34 PM
> To: hdfs-user@hadoop.apache.org
> Subject: Re: Best option for mounting HDFS
>
> Hi,
>
> I wrote up a small article about, that works in some installations I
> managed.
> http://mapredit.blogspot.com/2011/11/nfs-exported-hdfs-cdh3.html
>
> I would suggest to use NFS4, if available in your distro.
> On Wed, Nov 30, 2011 at 6:10 AM, Stuti Awasthi <stutiawasthi@hcl.com>
> wrote:
> Hey Joey,
> Thanks for update :). I will try both as you have suggested .
>
> -----Original Message-----
> From: Joey Echeverria [mailto:joey@cloudera.com]
> Sent: Tuesday, November 29, 2011 7:25 PM
> To: hdfs-user@hadoop.apache.org
> Subject: Re: Best option for mounting HDFS
>
> Hey Stuti,
>
> Fuse is probably the most commonly used solution. It has some limitations
> because HDFS isn't posix compliant, but it it works for a lot of use cases.
> You can try out both the contrib driver and the google code version. I'm
> not sure which will work better for your Hadoop version. Newer Hadoop
> releases have a lot of fuse related improvements.
>
> -Joey
>
> On Tue, Nov 29, 2011 at 2:44 AM, Alexander C.H. Lorenz <
> wget.null@googlemail.com> wrote:
> > Hi Stuti,
> > I have good experience with FUSE (http://fuse.sourceforge.net/), but
> > thats not a recommandation.
> > - alex
> >
> > On Tue, Nov 29, 2011 at 5:38 AM, Stuti Awasthi <stutiawasthi@hcl.com>
> wrote:
> >>
> >> Hi Friends ,
> >> Any thoughts on this ??
> >>
> >> -----Original Message-----
> >> From: Stuti Awasthi
> >> Sent: Monday, November 28, 2011 2:51 PM
> >> To: hdfs-user@hadoop.apache.org
> >> Subject: Best option for mounting HDFS
> >>
> >> Hi all,
> >>
> >> I was looking at various options available to mount HDFS on unix
> >> boxes. I found following option on wiki page.
> >> * contrib/fuse-dfs is built on fuse, some C glue, libhdfs and the
> >> hadoop-dev.jar
> >>
> >> * fuse-j-hdfs is built on fuse, fuse for java, and the hadoop-dev.jar
> >>
> >> * hdfs-fuse - a google code project is very similar to
> >> contrib/fuse-dfs
> >>
> >> * webdav - hdfs exposed as a webdav resource
> >>
> >> * mapR - contains a closed source hdfs compatible file system that
> >> supports read/write NFS access
> >>
> >> I tried webdav but then its integration problem with LDAP. In my
> >> scenario I wanted to mount HDFS and apply LDAP authentication over that
> mount point.
> >> I wanted to know out of the above , which will work best for this
> >> scenario.
> >> Please Suggest
> >>
> >> Stuti
> >>
> >> ::DISCLAIMER::
> >>
> >> ---------------------------------------------------------------------
> >> --------------------------------------------------
> >>
> >> The contents of this e-mail and any attachment(s) are confidential
> >> and intended for the named recipient(s) only.
> >> It shall not attach any liability on the originator or HCL or its
> >> affiliates. Any views or opinions presented in this email are solely
> >> those of the author and may not necessarily reflect the opinions of
> >> HCL or its affiliates.
> >> Any form of reproduction, dissemination, copying, disclosure,
> >> modification, distribution and / or publication of this message
> >> without the prior written consent of the author of this e-mail is
> >> strictly prohibited. If you have received this email in error please
> >> delete it and notify the sender immediately. Before opening any mail
> >> and attachments please check them for viruses and defect.
> >>
> >>
> >> ---------------------------------------------------------------------
> >> --------------------------------------------------
> >
> >
> >
> > --
> > Alexander Lorenz
> > http://mapredit.blogspot.com
> > P Think of the environment: please don't print this email unless you
> > really need to.
> >
> >
>
>
>
> --
> Joseph Echeverria
> Cloudera, Inc.
> 443.305.9434
>
>
>
>
> --
> Alexander Lorenz
> http://mapredit.blogspot.com
>
> Think of the environment: please don't print this email unless you
> really need to.
>
>
>


-- 
Alexander Lorenz
http://mapredit.blogspot.com

*P **Think of the environment: please don't print this email unless you
really need to.*

Mime
View raw message