Return-Path: X-Original-To: apmail-hive-user-archive@www.apache.org Delivered-To: apmail-hive-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C24F19917 for ; Fri, 16 Dec 2011 08:00:17 +0000 (UTC) Received: (qmail 86793 invoked by uid 500); 16 Dec 2011 08:00:16 -0000 Delivered-To: apmail-hive-user-archive@hive.apache.org Received: (qmail 86759 invoked by uid 500); 16 Dec 2011 08:00:16 -0000 Mailing-List: contact user-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hive.apache.org Delivered-To: mailing list user@hive.apache.org Received: (qmail 86751 invoked by uid 99); 16 Dec 2011 08:00:16 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 16 Dec 2011 08:00:16 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jingjungng@gmail.com designates 74.125.82.54 as permitted sender) Received: from [74.125.82.54] (HELO mail-ww0-f54.google.com) (74.125.82.54) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 16 Dec 2011 08:00:10 +0000 Received: by wgbdt13 with SMTP id dt13so4972787wgb.23 for ; Thu, 15 Dec 2011 23:59:49 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:date:message-id:subject:from:to:content-type; bh=JGc0CqFYVJeWJr70ADaKPRNryVLV+hyTYO4z3/frxUg=; b=uxZ2w7HiehrGKKMpCjfApAzQfM44XQ1Jmqv9ewA7XTSZR5H48DYwTjfBI2AHLW/He9 s7tON7FB/A0EpleSWPZDTi9EPHy7pTxVofVZWrvg4WxxCS7XBHbB/Qb62vWbUt+WDCfp W1QtkDPvKlhaPu62BtI8DORuAZYmmewdq59/s= MIME-Version: 1.0 Received: by 10.180.107.229 with SMTP id hf5mr10526149wib.35.1324022389348; Thu, 15 Dec 2011 23:59:49 -0800 (PST) Received: by 10.216.157.8 with HTTP; Thu, 15 Dec 2011 23:59:49 -0800 (PST) Date: Thu, 15 Dec 2011 23:59:49 -0800 Message-ID: Subject: hive select count(*) query exception From: jingjung Ng To: user@hive.apache.org Content-Type: multipart/alternative; boundary=e89a8f23567d3117bb04b430fc11 --e89a8f23567d3117bb04b430fc11 Content-Type: text/plain; charset=ISO-8859-1 Hi, I have simple hive select count(*) query,which results in the following exception. I am using Cloudera cdh3u1 ( hadoop/hbase/hive). However I am able to do "select * from t1" from hive CLI. Here is output after running "select count(*) from t1". hive> select count(*) from t1; Total MapReduce jobs = 1 Launching Job 1 out of 1 Number of reduce tasks determined at compile time: 1 In order to change the average load for a reducer (in bytes): set hive.exec.reducers.bytes.per.reducer= In order to limit the maximum number of reducers: set hive.exec.reducers.max= In order to set a constant number of reducers: set mapred.reduce.tasks= org.apache.hadoop.ipc.RemoteException: IPC server unable to read call parameters: java.lang.NoSuchMethodException: org.apache.hadoop.fs.permission.FsPermission$2.() at org.apache.hadoop.ipc.Client.call(Client.java:1107) at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:226) at $Proxy4.setPermission(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59) at $Proxy4.setPermission(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.setPermission(DFSClient.java:855) at org.apache.hadoop.hdfs.DistributedFileSystem.setPermission(DistributedFileSystem.java:560) at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:123) at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:839) at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:833) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127) at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:833) at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:807) at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:657) at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:123) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:130) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1063) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:900) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:748) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:209) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:286) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:513) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:186) Job Submission failed with exception 'org.apache.hadoop.ipc.RemoteException(IPC server unable to read call parameters: java.lang.NoSuchMethodException: org.apache.hadoop.fs.permission.FsPermission$2.())' FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask hive> Thanks, Jing. --e89a8f23567d3117bb04b430fc11 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hi,

I have simple hive select count(*) query,which results in the fo= llowing exception. I am using Cloudera cdh3u1 ( hadoop/hbase/hive). However= I am able to do "select * from t1" from hive CLI.

Here is= output after running "select count(*) from t1".

hive> select count(*) from t1;
Total MapReduce jobs =3D 1
Laun= ching Job 1 out of 1
Number of reduce tasks determined at compile time: = 1
In order to change the average load for a reducer (in bytes):
=A0 s= et hive.exec.reducers.bytes.per.reducer=3D<number>
In order to limit the maximum number of reducers:
=A0 set hive.exec.redu= cers.max=3D<number>
In order to set a constant number of reducers:=
=A0 set mapred.reduce.tasks=3D<number>
org.apache.hadoop.ipc.R= emoteException: IPC server unable to read call parameters: java.lang.NoSuch= MethodException: org.apache.hadoop.fs.permission.FsPermission$2.<init>= ;()
=A0=A0=A0 at org.apache.hadoop.ipc.Client.call(Client.java:1107)
=A0=A0= =A0 at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:226)
=A0=A0=A0 = at $Proxy4.setPermission(Unknown Source)
=A0=A0=A0 at sun.reflect.Native= MethodAccessorImpl.invoke0(Native Method)
=A0=A0=A0 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccess= orImpl.java:39)
=A0=A0=A0 at sun.reflect.DelegatingMethodAccessorImpl.in= voke(DelegatingMethodAccessorImpl.java:25)
=A0=A0=A0 at java.lang.reflec= t.Method.invoke(Method.java:597)
=A0=A0=A0 at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod= (RetryInvocationHandler.java:82)
=A0=A0=A0 at org.apache.hadoop.io.retry= .RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)
=A0=A0=A0= at $Proxy4.setPermission(Unknown Source)
=A0=A0=A0 at org.apache.hadoop.hdfs.DFSClient.setPermission(DFSClient.java:= 855)
=A0=A0=A0 at org.apache.hadoop.hdfs.DistributedFileSystem.setPermis= sion(DistributedFileSystem.java:560)
=A0=A0=A0 at org.apache.hadoop.mapr= educe.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:123)
=A0=A0=A0 at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:839)=A0=A0=A0 at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:833)=
=A0=A0=A0 at java.security.AccessController.doPrivileged(Native Method)=
=A0=A0=A0 at javax.security.auth.Subject.doAs(Subject.java:396)
=A0=A0=A0 at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroup= Information.java:1127)
=A0=A0=A0 at org.apache.hadoop.mapred.JobClient.s= ubmitJobInternal(JobClient.java:833)
=A0=A0=A0 at org.apache.hadoop.mapr= ed.JobClient.submitJob(JobClient.java:807)
=A0=A0=A0 at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.j= ava:657)
=A0=A0=A0 at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(= MapRedTask.java:123)
=A0=A0=A0 at org.apache.hadoop.hive.ql.exec.Task.ex= ecuteTask(Task.java:130)
=A0=A0=A0 at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRu= nner.java:57)
=A0=A0=A0 at org.apache.hadoop.hive.ql.Driver.launchTask(D= river.java:1063)
=A0=A0=A0 at org.apache.hadoop.hive.ql.Driver.execute(D= river.java:900)
=A0=A0=A0 at org.apache.hadoop.hive.ql.Driver.run(Driver.java:748)
=A0= =A0=A0 at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:20= 9)
=A0=A0=A0 at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriv= er.java:286)
=A0=A0=A0 at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:513)<= br>=A0=A0=A0 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)=
=A0=A0=A0 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAc= cessorImpl.java:39)
=A0=A0=A0 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMeth= odAccessorImpl.java:25)
=A0=A0=A0 at java.lang.reflect.Method.invoke(Met= hod.java:597)
=A0=A0=A0 at org.apache.hadoop.util.RunJar.main(RunJar.jav= a:186)
Job Submission failed with exception 'org.apache.hadoop.ipc.R= emoteException(IPC server unable to read call parameters: java.lang.NoSuchM= ethodException: org.apache.hadoop.fs.permission.FsPermission$2.<init>= ())'
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.= MapRedTask
hive>


Thanks,

Jing.

--e89a8f23567d3117bb04b430fc11--