hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ch huang <justlo...@gmail.com>
Subject Re: issue about Job running in-process (local Hadoop)
Date Tue, 13 May 2014 00:01:31 GMT
i am not config a local hadoop ,i just miss
/etc/hadoop/conf/mapred-site.xml, now it's work

On Mon, May 12, 2014 at 4:42 PM, Shengjun Xin <sxin@gopivotal.com> wrote:

>  According to the log, you configured a local hadoop, you need to check
> you configuration
>
>
> On Mon, May 12, 2014 at 3:46 PM, ch huang <justlooks@gmail.com> wrote:
>
>> hi,maillist:
>>        i try hive 0.12,but it always run job in local mode ,why? i
>> install hive on a seperate hox ,and install hadoop client on it ,and
>> configure the client connect to my hadoop cluster
>>
>> hive> select count(*) from media_visit_info;
>> Total MapReduce jobs = 1
>> Launching Job 1 out of 1
>> Number of reduce tasks determined at compile time: 1
>> In order to change the average load for a reducer (in bytes):
>>   set hive.exec.reducers.bytes.per.reducer=<number>
>> In order to limit the maximum number of reducers:
>>   set hive.exec.reducers.max=<number>
>> In order to set a constant number of reducers:
>>   set mapred.reduce.tasks=<number>
>> 14/05/12 15:36:52 WARN conf.Configuration:
>> file:/tmp/root/hive_2014-05-12_15-36-48_130_3729255905600309633-1/-local-10002/jobconf.xml:an
>> attempt to override final parameter:
>> mapreduce.job.end-notification.max.retry.interval;  Ignoring.
>> 14/05/12 15:36:52 WARN conf.Configuration:
>> file:/tmp/root/hive_2014-05-12_15-36-48_130_3729255905600309633-1/-local-10002/jobconf.xml:an
>> attempt to override final parameter:
>> mapreduce.job.end-notification.max.attempts;  Ignoring.
>> 14/05/12 15:36:52 INFO Configuration.deprecation:
>> mapred.input.dir.recursive is deprecated. Instead, use
>> mapreduce.input.fileinputformat.input.dir.recursive
>> 14/05/12 15:36:52 INFO Configuration.deprecation: mapred.max.split.size
>> is deprecated. Instead, use mapreduce.input.fileinputformat.split.maxsize
>> 14/05/12 15:36:52 INFO Configuration.deprecation: mapred.min.split.size
>> is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
>> 14/05/12 15:36:52 INFO Configuration.deprecation:
>> mapred.min.split.size.per.rack is deprecated. Instead, use
>> mapreduce.input.fileinputformat.split.minsize.per.rack
>> 14/05/12 15:36:52 INFO Configuration.deprecation:
>> mapred.min.split.size.per.node is deprecated. Instead, use
>> mapreduce.input.fileinputformat.split.minsize.per.node
>> 14/05/12 15:36:52 INFO Configuration.deprecation: mapred.reduce.tasks is
>> deprecated. Instead, use mapreduce.job.reduces
>> 14/05/12 15:36:52 INFO Configuration.deprecation:
>> mapred.reduce.tasks.speculative.execution is deprecated. Instead, use
>> mapreduce.reduce.speculative
>> Execution log at:
>> /tmp/root/root_20140512153636_d3088311-cdbe-44c4-8622-e47dce685f34.log
>> Job running in-process (local Hadoop)
>> 2014-05-12 15:36:56,257 null map = 0%,  reduce = 0%
>> 2014-05-12 15:36:59,275 null map = 100%,  reduce = 0%
>> 2014-05-12 15:37:01,314 null map = 100%,  reduce = 100%
>> Ended Job = job_local1940121222_0001
>> Execution completed successfully
>> MapredLocal task succeeded
>> OK
>> 3093138
>> Time taken: 14.136 seconds, Fetched: 1 row(s)
>>
>
>
>
> --
>  Regards
> Shengjun
>

Mime
View raw message