hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bejoy KS" <bejoy.had...@gmail.com>
Subject Re: HDFS Installation / Configuration
Date Tue, 17 Jul 2012 12:54:36 GMT
Hi Yuvrajsinh

In hdfs the directory information exixts as metadata on the name node. The data is stored
as hdfs blocks on datanodes. 

You can list the created dir/files in hdfs using

hadoop fs -ls /

Bejoy KS

Sent from handheld, please excuse typos.

-----Original Message-----
From: "Yuvrajsinh Chauhan" <yuvraj.chauhan@elitecore.com>
Date: Tue, 17 Jul 2012 18:02:15 
To: <hdfs-user@hadoop.apache.org>
Reply-To: hdfs-user@hadoop.apache.org
Subject: RE: HDFS Installation / Configuration

Dear Tariq,

All Web GUI are working fine. I can be able to make the directories using
./hadoop fs -mkdir command. (For Ex. ./hadoop fs -mkdir /test)
But where this files are getting created ? also the same directory created
on both the Node ?

I can see folder created on Namenode->Browse the filesystem Link. But the
same was not available on OS Level.

Sorry, But I am new in HDFS. So please excuse me for silly questions.

Yuvrajsinh Chauhan 

-----Original Message-----
From: Mohammad Tariq [mailto:dontariq@gmail.com] 
Sent: 17 July 2012 17:19
To: hdfs-user@hadoop.apache.org
Subject: Re: HDFS Installation / Configuration

Hello Yuvrajsinh,

        Hadoop provides us web interfaces using which we can see the status
of our cluster to check if everything is ok. Simply point your web browser
to http://namenode_host:50070(for Hdfs status) and to
http://jobtracker_host:50030(for MapReduce status). Apart from this just
give a try to few basic shell commands to see if everything is going
fine(like bin/hadoop fs -ls /, bin/hadoop fs -mkdir /testdir etc). Also try
to run the wordcount program once.

    Mohammad Tariq

On Tue, Jul 17, 2012 at 3:34 PM, Yuvrajsinh Chauhan
<yuvraj.chauhan@elitecore.com> wrote:
> Dear All,
> I have completed all installation & configuration. I have setup HDFS 
> between two nodes.
> Currently my Data node and Task Tracker services are running on both 
> the nodes.
> Now please let me know how I test this FS ?
> Also, I want to format additional partition with HDFS. Please provide 
> the steps for this activity.
> Thanks.
> Regards,
> Yuvrajsinh Chauhan
> -----Original Message-----
> From: Harsh J [mailto:harsh@cloudera.com]
> Sent: 01 May 2012 18:15
> To: hdfs-user@hadoop.apache.org
> Subject: Re: HDFS Installation / Configuration
> Hey Yuvrajsinh,
> Have you tried / taken the time to follow the official setup guides?
> For a single node, start with
> http://hadoop.apache.org/common/docs/stable/single_node_setup.html,
> followed by 
> http://hadoop.apache.org/common/docs/stable/cluster_setup.html
> for a fully-distributed cluster (multi-node) setup.
> From community, Michael Noll maintains excellent notes on setting up 
> clusters at his tutorials page http://www.michael-noll.com/tutorials/
> If you do not want MapReduce, just ignore the steps that relate to it.
> On Tue, May 1, 2012 at 6:00 PM, Yuvrajsinh Chauhan 
> <yuvraj.chauhan@elitecore.com> wrote:
>> All,
>> I'm a new in this community. I want to install HDFS on Linux Box.
>> Would appreciate if anyone can share installation steps / download 
>> location of binary / performance parameter etc. Thanks in Adv.
>> Regards,
>> Yuvrajsinh Chauhan || CRESTEL || Sr. DBA
>> Elitecore Technologies Pvt. Ltd.
> --
> Harsh J

View raw message