hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Matt Pestritto <m...@pestritto.com>
Subject Re: vote for release candidate for hive
Date Thu, 17 Sep 2009 20:34:29 GMT
Please disregard.  I found the cause of my error.

Thanks.

On Thu, Sep 17, 2009 at 3:09 PM, Matt Pestritto <matt@pestritto.com> wrote:

> I recently switched to the 0.4 branch to do some testing and I'm running
> into a problem.
>
> When I run a query from the cli - the first one works, but the second query
> always fails with a NullPointerException.
>
> Did anyone else run into this ?
>
> Thanks
> -Matt
>
> hive> select count(1) from table1;
> Total MapReduce jobs = 1
> Number of reduce tasks determined at compile time: 1
> In order to change the average load for a reducer (in bytes):
>   set hive.exec.reducers.bytes.per.reducer=<number>
> In order to limit the maximum number of reducers:
>   set hive.exec.reducers.max=<number>
> In order to set a constant number of reducers:
>   set mapred.reduce.tasks=<number>
> Starting Job = job_200909171501_0001, Tracking URL =
> http://mustique:50030/jobdetails.jsp?jobid=job_200909171501_0001
> Kill Command = /home/hadoop/hadoop/bin/../bin/hadoop job
> -Dmapred.job.tracker=mustique:9001 -kill job_200909171501_0001
> 2009-09-17 03:05:54,855 map = 0%,  reduce =0%
> 2009-09-17 03:06:02,895 map = 22%,  reduce =0%
> 2009-09-17 03:06:06,933 map = 44%,  reduce =0%
> 2009-09-17 03:06:11,965 map = 67%,  reduce =0%
> 2009-09-17 03:06:15,988 map = 89%,  reduce =0%
> 2009-09-17 03:06:20,009 map = 100%,  reduce =0%
> 2009-09-17 03:06:25,036 map = 100%,  reduce =11%
> 2009-09-17 03:06:30,054 map = 100%,  reduce =15%
> 2009-09-17 03:06:31,063 map = 100%,  reduce =22%
> 2009-09-17 03:06:34,075 map = 100%,  reduce =26%
> 2009-09-17 03:06:36,101 map = 100%,  reduce =100%
> Ended Job = job_200909171501_0001
> OK
> 274087
> Time taken: 45.401 seconds
> hive> select count(1) from table1;
> Total MapReduce jobs = 1
> Number of reduce tasks determined at compile time: 1
> In order to change the average load for a reducer (in bytes):
>   set hive.exec.reducers.bytes.per.reducer=<number>
> In order to limit the maximum number of reducers:
>   set hive.exec.reducers.max=<number>
> In order to set a constant number of reducers:
>   set mapred.reduce.tasks=<number>
> java.lang.NullPointerException
>     at
> org.apache.hadoop.hive.ql.exec.Utilities.setMapRedWork(Utilities.java:154)
>     at
> org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:373)
>     at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:379)
>     at org.apache.hadoop.hive.ql.Driver.run(Driver.java:285)
>     at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:123)
>     at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:181)
>     at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:287)
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     at java.lang.reflect.Method.invoke(Method.java:597)
>     at org.apache.hadoop.util.RunJar.main(RunJar.java:155)
>     at org.apache.hadoop.mapred.JobShell.run(JobShell.java:54)
>     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
>     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
>     at org.apache.hadoop.mapred.JobShell.main(JobShell.java:68)
> Job Submission failed with exception
> 'java.lang.RuntimeException(java.lang.NullPointerException)'
> FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.ExecDriver
> hive>
>
>
> On Thu, Sep 17, 2009 at 12:36 PM, Namit Jain <njain@facebook.com> wrote:
>
>> https://issues.apache.org/jira/browse/HIVE-838
>>
>> is a blocker for 0.4 -
>> Once this is merged, I will have another release candidate
>>
>>
>> -----Original Message-----
>> From: Johan Oskarsson [mailto:johan@oskarsson.nu]
>> Sent: Wednesday, September 16, 2009 8:29 AM
>> To: hive-dev@hadoop.apache.org
>> Subject: Re: vote for release candidate for hive
>>
>> +1 based on running unit tests.
>>
>> /Johan
>>
>> Namit Jain wrote:
>> > Sorry, was meant for hive-dev@
>> >
>> > From: Namit Jain [mailto:njain@facebook.com]
>> > Sent: Tuesday, September 15, 2009 1:30 PM
>> > To: hive-user@hadoop.apache.org
>> > Subject: vote for release candidate for hive
>> >
>> >
>> > I have created another release candidate for Hive.
>> >
>> >
>> >
>> >  https://svn.apache.org/repos/asf/hadoop/hive/tags/release-0.4.0-rc1/
>> >
>> >
>> >
>> >
>> >
>> > Let me know if it is OK to publish this release candidate.
>> >
>> >
>> >
>> > The only change from the previous candidate (
>> https://svn.apache.org/repos/asf/hadoop/hive/tags/release-0.4.0-rc0/) is
>> the fix for
>> >
>> > https://issues.apache.org/jira/browse/HIVE-718
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> > Thanks,
>> >
>> > -namit
>> >
>> >
>> >
>> >
>>
>>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message