hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From bharath vissapragada <bharathvissapragada1...@gmail.com>
Subject Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Date Tue, 21 May 2013 18:12:29 GMT
Yes !

On Tue, May 21, 2013 at 11:41 PM, Raj Hadoop <hadoopraj@yahoo.com> wrote:

> So that means I need to create a HDFS ( Not an OS physical directory )
> directory under Hadoop that need to be used in the Hive config file for
> this property. Right?
>
>   *From:* Dean Wampler <deanwampler@gmail.com>
> *To:* Raj Hadoop <hadoopraj@yahoo.com>
> *Cc:* Sanjay Subramanian <Sanjay.Subramanian@wizecommerce.com>; "
> user@hive.apache.org" <user@hive.apache.org>; User <user@hadoop.apache.org>
>
> *Sent:* Tuesday, May 21, 2013 2:06 PM
>
> *Subject:* Re: hive.metastore.warehouse.dir - Should it point to a
> physical directory
>
> No, you only need a directory in HDFS, which will be "virtually located"
> somewhere in your cluster automatically by HDFS.
>
> Also there's a typo in your hive.xml:
>
>    <value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
>
> Should be
>
>    <value>/correct/path/in/hdfs/to/your/warehouse/directory</value>
>
> On Tue, May 21, 2013 at 1:04 PM, Raj Hadoop <hadoopraj@yahoo.com> wrote:
>
>  Thanks Sanjay.
>
> My environment is  like this.
>
> $ echo $HADOOP_HOME
> /software/home/hadoop/hadoop/hadoop-1.1.2
>
> $ echo $HIVE_HOME
> /software/home/hadoop/hive/hive-0.9.0
>
> $ id
> uid=50052(hadoop) gid=600(apps) groups=600(apps)
>
> So can i do like this:
>
> $pwd
> /software/home/hadoop/hive/hive-0.9.0
>
> $mkdir warehouse
>
> $cd /software/home/hadoop/hive/hive-0.9.0/warehouse
>
> $ in hive-site.xml
> <property>
>   <name>hive.metastore.warehouse.dir</name>
>   <value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
>    <description>location of default database for the
> warehouse</description>
> </property>
>
> Where should I create the HDFS directory ?
>
>
>   *From:* Sanjay Subramanian <Sanjay.Subramanian@wizecommerce.com>
> *To:* "user@hive.apache.org" <user@hive.apache.org>; Raj Hadoop <
> hadoopraj@yahoo.com>; Dean Wampler <deanwampler@gmail.com>
> *Cc:* User <user@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:53 PM
>
> *Subject:* Re: hive.metastore.warehouse.dir - Should it point to a
> physical directory
>
>  Notes below
>
>  From: Raj Hadoop <hadoopraj@yahoo.com>
> Reply-To: "user@hive.apache.org" <user@hive.apache.org>, Raj Hadoop <
> hadoopraj@yahoo.com>
> Date: Tuesday, May 21, 2013 10:49 AM
> To: Dean Wampler <deanwampler@gmail.com>, "user@hive.apache.org" <
> user@hive.apache.org>
> Cc: User <user@hadoop.apache.org>
> Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical
> directory
>
>   Ok.I got it. My questions -
>
> 1) Should a local physical directory be created before using this property?
>  I created a directory in HDFS during Hive installation
> /user/hive/warehouse
>
> My hive-site.xml has the following property defined
>
> <property>
>   <name>hive.metastore.warehouse.dir</name>
>   <value>/user/hive/warehouse</value>
>   <description>location of default database for the
> warehouse</description>
> </property>
>
>   2) Should a HDFS file directory be created from Hadoop before using
> this property?
>  hdfs dfs -mkdir /user/hive/warehouse
> Change the owner:group to hive:hive
>
>
>
>   *From:* Dean Wampler <deanwampler@gmail.com>
> *To:* user@hive.apache.org; Raj Hadoop <hadoopraj@yahoo.com>
> *Cc:* User <user@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:44 PM
> *Subject:* Re: hive.metastore.warehouse.dir - Should it point to a
> physical directory
>
> The name is misleading; this is the directory within HDFS where Hive
> stores the data, by default. (External tables can go elsewhere). It doesn't
> really have anything to do with the metastore.
>
> dean
>
> On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <hadoopraj@yahoo.com> wrote:
>
>  Can some one help me on this ? I am stuck installing and configuring
> Hive with Oracle. Your timely help is really aprreciated.
>
>   *From:* Raj Hadoop <hadoopraj@yahoo.com>
> *To:* Hive <user@hive.apache.org>; User <user@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:08 PM
> *Subject:* hive.metastore.warehouse.dir - Should it point to a physical
> directory
>
>   Hi,
>
> I am configurinig Hive. I ahve a question on the property
> hive.metastore.warehouse.dir.
>
> Should this point to a physical directory. I am guessing it is a logical
> directory under Hadoop fs.default.name. Please advise whether I need to
> create any directory for the variable hive.metastore.warehouse.dir
>
> Thanks,
> Raj
>
>
>
>
>
> --
> Dean Wampler, Ph.D.
> @deanwampler
> http://polyglotprogramming.com/
>
>
>
> CONFIDENTIALITY NOTICE
> ======================
> This email message and any attachments are for the exclusive use of the
> intended recipient(s) and may contain confidential and privileged
> information. Any unauthorized review, use, disclosure or distribution is
> prohibited. If you are not the intended recipient, please contact the
> sender by reply email and destroy all copies of the original message along
> with any attachments, from your computer system. If you are the intended
> recipient, please be advised that the content of this message is subject to
> access, review and disclosure by the sender's Email System Administrator.
>
>
>
>
>
> --
> Dean Wampler, Ph.D.
> @deanwampler
> http://polyglotprogramming.com/
>
>
>

Mime
View raw message