Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 43E46CEE8 for ; Tue, 11 Jun 2013 17:33:47 +0000 (UTC) Received: (qmail 99254 invoked by uid 500); 11 Jun 2013 17:33:42 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 98959 invoked by uid 500); 11 Jun 2013 17:33:41 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 98952 invoked by uid 99); 11 Jun 2013 17:33:41 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 11 Jun 2013 17:33:41 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of shahab.yunus@gmail.com designates 209.85.214.45 as permitted sender) Received: from [209.85.214.45] (HELO mail-bk0-f45.google.com) (209.85.214.45) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 11 Jun 2013 17:33:36 +0000 Received: by mail-bk0-f45.google.com with SMTP id je9so2577532bkc.4 for ; Tue, 11 Jun 2013 10:33:15 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=uf332cFOr3UdLSW9plWcjGlxvnRbc0Q0U/AN18aYCoY=; b=Zlexq3H0NTIbT+WsDaiEfvIbGG96PknhDO3THfq6mASPtjMrt9HFqu2Cb1A7DZ7/U7 uZ4IMi0ulx+IWf23dSmu35XdfOBxTo7qp6sIR6z8N+wirfc+f2dcAEUyUt8Jd7sA/9B6 w71lFmBxjS4wv6uQ2YQsaiV1AqSsxBOvsBBz4vK/BOek3nk7p7iepE/ljQCWPbcvw6c6 7soS3I2X6aSD4ADPRqRNR4xQMyYvR6o78rmv1B7OA4YdCza3zgPGyC7VmWjxRUgfNkWr h+BUVWUeLhLl0SOUaT0GohqgLdz2hg1lmRUnpG6Qdrn0d9Asn+LOXtD+C9JEdCX4temK BJzg== MIME-Version: 1.0 X-Received: by 10.204.166.133 with SMTP id m5mr2508817bky.78.1370971995345; Tue, 11 Jun 2013 10:33:15 -0700 (PDT) Received: by 10.205.37.7 with HTTP; Tue, 11 Jun 2013 10:33:15 -0700 (PDT) In-Reply-To: <1370970528.22099.YahooMailNeo@web162203.mail.bf1.yahoo.com> References: <1370960538.15828.YahooMailNeo@web162205.mail.bf1.yahoo.com> <1370961776.73685.YahooMailNeo@web162202.mail.bf1.yahoo.com> <1370970528.22099.YahooMailNeo@web162203.mail.bf1.yahoo.com> Date: Tue, 11 Jun 2013 13:33:15 -0400 Message-ID: Subject: Re: HDFS to a different location other than HADOOP HOME From: Shahab Yunus To: "user@hadoop.apache.org" , Raj Hadoop Content-Type: multipart/alternative; boundary=bcaec51a73f2c7c54204dee44a13 X-Virus-Checked: Checked by ClamAV on apache.org --bcaec51a73f2c7c54204dee44a13 Content-Type: text/plain; charset=ISO-8859-1 http://hadoop.apache.org/docs/stable/hdfs-default.html dfs.data.dir${hadoop.tmp.dir}/dfs/dataDetermines where on the local filesystem an DFS data node should store its blocks. If this is a comma-delimited list of directories, then data will be stored in all named directories, typically on different devices. Directories that do not exist are ignored. On Tue, Jun 11, 2013 at 1:08 PM, Raj Hadoop wrote: > Hi Tariq, > > What is the default value of dfs.data.dir? My hdfs-site.xml doesnt have > this value defined. So what is the default value? > > Thanks, > Raj > > *From:* Mohammad Tariq > *To:* "user@hadoop.apache.org" ; Raj Hadoop < > hadoopraj@yahoo.com> > *Sent:* Tuesday, June 11, 2013 12:49 PM > *Subject:* Re: HDFS to a different location other than HADOOP HOME > > Hello Raj, > > Although the way which Mustaqeem has told is correct, there is more > appropriate way to do this. Add the "dfs.data.dir" property in your > hdfs-site.xml and give the "path you want to use for HDFS data storage" as > its value. The directory pointed by hadoop.tmp.dir also contains the > metadata and some other temporary files, so it's always better to have a > dedicated location to store the actual HDFS data. > > Warm Regards, > Tariq > cloudfront.blogspot.com > > > On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop wrote: > > > Thanks Mustaqeem. > > hadoop.tmp.dir - Can this store HDFS files? I mean - is there any > difference in files from the one we create under HADOOP_HOME. > > > > *From:* Mohammad Mustaqeem <3m.mustaqeem@gmail.com> > *To:* user ; Raj Hadoop > *Sent:* Tuesday, June 11, 2013 10:28 AM > *Subject:* Re: HDFS to a different location other than HADOOP HOME > > You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as > - > > hadoop.tmp.dir > /app/software/app1 > > "/app/software/app1" will be used as location for storing the hdfs files. > > > > On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop wrote: > > Hi, > > I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a > directory > > /usr/home/hadoop > > I dont have much space on /usr and want to use other accounts/applications > storage which are located at /app/software/app1 etc., > > How can I use the /app/software/app1 location for my HDFS files and > storage. Is it possible? Please advise. > > Thanks, > Raj > > > > > -- > *With regards ---* > *Mohammad Mustaqeem*, > M.Tech (CSE) > MNNIT Allahabad > 9026604270 > > > > > > > > --bcaec51a73f2c7c54204dee44a13 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
http://hadoop.apache.org/docs/stable/hdfs-default.html
dfs.data.dir ${hadoop.tmp.dir}/dfs/dataDetermines where on the local filesy= stem an DFS data node should store its blocks. If this is a comma-delimited= list of directories, then data will be stored in all named directories, ty= pically on different devices. Directories that do not exist are ignored.


On Tue, Jun 11, 2013 at 1:08 PM, Raj Hadoop <hadoo= praj@yahoo.com> wrote:
Hi Tariq,
=A0
What is the default value of dfs.data.dir? My hdfs-site.xml does= nt have this value defined. So what is the default value?
=A0
Thanks,
Raj


Hello Raj,

=A0 =A0 Although the way which Mustaqeem has told is correct, there is= more appropriate way to do this. Add the "dfs.data.dir" property= in your hdfs-site.xml and give the "path you want to use for HDFS dat= a storage" as its value. The directory pointed by hadoop.tmp.dir also = contains the metadata and some other temporary files, so it's always be= tter to have a dedicated location to store the actual HDFS data.



On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <hadoo= praj@yahoo.com> wrote:
=A0
Thanks Mustaqeem.
=A0
hadoop.tmp.dir - Can this store HDFS files? I mean - is there an= y difference in files from the one we create under HADOOP_HOME.<= /span>
=A0
=A0

From:= Mohammad Mustaqeem <3m.mustaqeem@gmail.com>
To: user <user@hadoop.apache.org= >; Raj Hadoop <hadoopraj@yahoo.com>
Sent: Tuesday, June 11, 2013= 10:28 AM
Subject: Re: HD= FS to a different location other than HADOOP HOME

You can mentioned the "hadoop.tmp.dir" property = in the core-site.xml as -=20
<property>
<name>hadoop.tmp.dir= </name>
<value>/app/software/app1</value>
</property>
"/app/software/app1" w= ill be used as location for storing the hdfs files.



On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <hadoo= praj@yahoo.com> wrote:
Hi,
=A0
I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under = a directory
=A0
/usr/home/hadoop
=A0
I dont have much space on /usr and want to use other accounts/applicat= ions storage which are located at /app/software/app1 etc.,
=A0
How can I use the /app/software/app1 location for my HDFS files and st= orage. Is it possible? Please advise.
=A0
Thanks,
Raj



--
With regards ---
Mohammad Mustaqee= m,
M.Tech (CSE)<= /div>
MNNIT Allahabad






=

--bcaec51a73f2c7c54204dee44a13--