hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From paul <paulg...@gmail.com>
Subject Re: Try to mount HDFS
Date Fri, 23 Apr 2010 00:06:01 GMT
Just a heads up on this, we've run into problems when trying to use fuse to
mount dfs running on port :8020.  However, it works fine when we ran it on
:9000.


-paul


On Thu, Apr 22, 2010 at 7:59 PM, Brian Bockelman <bbockelm@cse.unl.edu>wrote:

> Hey Christian,
>
> I've run into this before.
>
> Make sure that the hostname/port you give to fuse is EXACTLY the same as
> listed in hadoop-site.xml.
>
> If these aren't the same text string (including the ":8020"), then you get
> those sort of issues.
>
> Brian
>
> On Apr 22, 2010, at 5:00 AM, Christian Baun wrote:
>
> > Dear All,
> >
> > I want to test HDFS inside Amazon EC2.
> >
> > Two Ubuntu instances are running inside EC2.
> > One server is namenode and jobtracker. The other server is the datanode.
> > Cloudera (hadoop-0.20) is installed and running.
> >
> > Now, I want to mount HDFS.
> > I tried to install contrib/fuse-dfs as described here:
> > http://wiki.apache.org/hadoop/MountableHDFS
> >
> > The compilation worked via:
> >
> > # ant compile-c++-libhdfs -Dlibhdfs=1
> > # ant package -Djava5.home=/usr/lib/jvm/java-1.5.0-sun-1.5.0.06/
> -Dforrest.home=/home/ubuntu/apache-forrest-0.8/
> > # ant compile-contrib -Dlibhdfs=1 -Dfusedfs=1
> >
> > But now, when I try to mount the filesystem:
> >
> > # ./fuse_dfs_wrapper.sh dfs://
> ec2-75-101-210-65.compute-1.amazonaws.com:8020 /mnt/hdfs/ -d
> > port=8020,server=ec2-75-101-210-65.compute-1.amazonaws.com
> > fuse-dfs didn't recognize /mnt/hdfs/,-2
> > fuse-dfs ignoring option -d
> > FUSE library version: 2.8.1
> > nullpath_ok: 0
> > unique: 1, opcode: INIT (26), nodeid: 0, insize: 56
> > INIT: 7.13
> > flags=0x0000007b
> > max_readahead=0x00020000
> >   INIT: 7.12
> >   flags=0x00000011
> >   max_readahead=0x00020000
> >   max_write=0x00020000
> >   unique: 1, success, outsize: 40
> >
> >
> > # ./fuse_dfs_wrapper.sh dfs://
> ec2-75-101-210-65.compute-1.amazonaws.com:8020 /mnt/hdfs/
> > port=8020,server=ec2-75-101-210-65.compute-1.amazonaws.com
> > fuse-dfs didn't recognize /mnt/hdfs/,-2
> >
> > # ls /mnt/hdfs/
> > ls: reading directory /mnt/hdfs/: Input/output error
> > # ls /mnt/hdfs/
> > ls: cannot access /mnt/hdfs/o¢  : No such file or directory
> > o???
> > # ls /mnt/hdfs/
> > ls: reading directory /mnt/hdfs/: Input/output error
> > # ls /mnt/hdfs/
> > ls: cannot access /mnt/hdfs/`á›Óÿ : No such file or directory
> > `?????
> > # ls /mnt/hdfs/
> > ls: reading directory /mnt/hdfs/: Input/output error
> > ...
> >
> >
> > What can I do at this point?
> >
> > Thanks in advance
> >     Christian
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message