hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mich Talebzadeh <mich.talebza...@gmail.com>
Subject Re: Hive setup on Hadoop cluster
Date Wed, 18 May 2016 17:48:17 GMT
Hi John,

can you please a new thread for your problem so we can deal with separately.

thanks

Dr Mich Talebzadeh



LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
<https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*



http://talebzadehmich.wordpress.com



On 18 May 2016 at 15:11, JOHN MILLER <jmill383@gmail.com> wrote:

> Greetings Mitch
>
> I have an issue with running mapreduce in hive   I am getting a  FAILED:
> Execution Error, return code 2 from
> org.apache.hadoop.hive.ql.exec.mr.MapRedTask
>
> error while attemtiing to execute SELECT DISTINCT(fieldname) FROM TABLE x
> or SELECT  COUNT(*)  FROM TABLE x;;  Trying to run cascading-hive gives me
> the same problem as well
>
> Please advise if u have come across this type of problem or generated some
> ideas as to resolve this problema
>
> On Wed, May 18, 2016 at 9:53 AM, Mich Talebzadeh <
> mich.talebzadeh@gmail.com> wrote:
>
>> Hi Kuldeep,
>>
>> Have you installed hive on any of these nodes.
>>
>> Hive is basically an API. You will also need to install sqoop as well if
>> you are going to import data from other RDBMss like Oracle, Sybase etc.
>>
>> Hive has a very small footprint so my suggestion is to install it on all
>> your boxes and permission granted to Haddop user say hduser.
>>
>> Hive will require a metadata in  a database of your choice. default is
>> derby which I don't use. try to use a reasonable database. ours is on
>> Oracle
>>
>>  Now under directory $HIVE_HOME/conf/hive-site.xml you can set up info
>> about Hadoop and your metastore etc. You also need to set up environment
>> variables for both Hadoop and hive in your start up script like .profile
>> .kshrc etc
>>
>> Have a look anyway.
>>
>> HTH
>>
>> Dr Mich Talebzadeh
>>
>>
>>
>> LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
>> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>>
>>
>>
>> http://talebzadehmich.wordpress.com
>>
>>
>>
>> On 18 May 2016 at 13:49, Kuldeep Chitrakar <
>> kuldeep.chitrakar@synechron.com> wrote:
>>
>>> I have a very basic question regarding Hadoop & Hive setup.  I have 7
>>> Machines say M1,M2,M3,M4,M5,M6,M7
>>>
>>>
>>>
>>> Hadoop Cluster Setup:
>>>
>>>
>>>
>>> Namenode: M1
>>>
>>> Seondary Namenode: M2
>>>
>>> Datanodes: M3,M4,M5
>>>
>>>
>>>
>>>
>>>
>>> Now question is:
>>>
>>>
>>>
>>> Where do I need to install Hive.
>>>
>>> 1.       Should I install Hiverserver on M6
>>>
>>> a.       if yes does that machine needs core Hadoop JAR’s installed?
>>>
>>> b.      How this Hive server knows where Hadoop cluster is. What
>>> configurations needs to be done?
>>>
>>> c.       How can we restrict this machine to be only hive server and
>>> not datanode of Hadoop cluster?
>>>
>>>
>>>
>>> 2.       Where do we install Hive CLI
>>>
>>> a.       If I want to hive M7 as Hive CLI, then what needs to be
>>> installed on this machine.
>>>
>>> b.      Any required configurations.
>>>
>>>
>>>
>>> Thanks,
>>>
>>> Kuldeep
>>>
>>>
>>>
>>
>>
>

Mime
View raw message