hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From John Villa <john.joe.vi...@gmail.com>
Subject Re: Hive Execution Errors
Date Fri, 22 Jan 2010 00:38:09 GMT
I will change the names soon and let you guys know. Home with the dogs
bothering me hehe.
Thanks,

On Thu, Jan 21, 2010 at 7:34 PM, John Villa <john.joe.villa@gmail.com>wrote:

> Thanks for the info. The only adding of jar files I did was this when
> creating a tables;
>
> add jar ../build/contrib/hive_contrib.jar;
>
>
>
>
> On Thu, Jan 21, 2010 at 7:00 PM, Ning Zhang <nzhang@facebook.com> wrote:
>
>> Thanks Carl. I'll take a look at the patch for HIVE-1063.
>>
>> Ning
>>
>> On Jan 21, 2010, at 3:44 PM, Carl Steinbach wrote:
>>
>>
>> The naming convention for Hive jar files was changed in HIVE-978 from
>> hive_foo.jar to hive-foo-VERSION.jar. This change currently affects all Hive
>> jars *except* hive_contrib.jar which was not changed because the
>> hive_contrib.jar filename is referenced in several test cases. HIVE-1063
>> fixes this problem by providing the ability to reference system property
>> variables in test case qfiles.
>>
>> Thanks.
>>
>> Carl
>>
>> On Thu, Jan 21, 2010 at 3:19 PM, Ning Zhang <nzhang@facebook.com> wrote:
>>
>>> This is Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
>>> java.lang.ClassNotFoundException:
>>> org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>
>>> The RegexSerDe is included in hive_contrib.jar. There may be an bug of
>>> the name here because all other jar files are following the same convention
>>> hive-*-0.6.0.jar. If you see all the other jar files in the lib directory
>>> following the convention, you probably need to rename hive_contrib.jar to
>>> hive-contrib-0.6.0.jar. Can you try that and let us know the result?
>>>
>>> Thanks,
>>> Ning
>>>
>>> On Jan 21, 2010, at 2:48 PM, John Villa wrote:
>>>
>>> Here is the output;
>>>
>>> java.lang.RuntimeException: Error in configuring object
>>> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>
>>>
>>>
>>> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>> 	at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>>
>>>
>>>
>>> Caused by: java.lang.reflect.InvocationTargetException
>>> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>
>>>
>>>
>>> 	at java.lang.reflect.Method.invoke(Method.java:597)
>>> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>> 	... 5 more
>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>>
>>>
>>>
>>> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>
>>>
>>>
>>> 	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>> 	... 10 more
>>> Caused by: java.lang.reflect.InvocationTargetException
>>> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>
>>>
>>>
>>> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>> 	at java.lang.reflect.Method.invoke(Method.java:597)
>>> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>
>>>
>>>
>>> 	... 13 more
>>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>>> 	at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>> 	... 18 more
>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException:
org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>
>>>
>>>
>>> 	at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>> 	at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>> 	... 18 more
>>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>
>>>
>>>
>>> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>> 	at java.security.AccessController.doPrivileged(Native Method)
>>> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>
>>>
>>>
>>> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>> 	at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>> 	at java.lang.Class.forName0(Native Method)
>>>
>>>
>>>
>>> 	at java.lang.Class.forName(Class.java:247)
>>> 	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>> 	at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>
>>>
>>>
>>> 	at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>> 	... 19 more
>>>
>>> java.lang.RuntimeException: Error in configuring object
>>> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>
>>>
>>>
>>> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>>
>>>
>>>
>>> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>> 	at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>> Caused by: java.lang.reflect.InvocationTargetException
>>> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>
>>>
>>>
>>> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>> 	at java.lang.reflect.Method.invoke(Method.java:597)
>>>
>>>
>>>
>>> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>> 	... 5 more
>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>
>>>
>>>
>>> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>> 	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>>
>>>
>>>
>>> 	... 10 more
>>> Caused by: java.lang.reflect.InvocationTargetException
>>> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>
>>>
>>>
>>> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>> 	at java.lang.reflect.Method.invoke(Method.java:597)
>>> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>
>>>
>>>
>>> 	... 13 more
>>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>>> 	at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>> 	... 18 more
>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException:
org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>
>>>
>>>
>>> 	at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>> 	at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>> 	... 18 more
>>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>
>>>
>>>
>>> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>> 	at java.security.AccessController.doPrivileged(Native Method)
>>> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>
>>>
>>>
>>> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>> 	at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>> 	at java.lang.Class.forName0(Native Method)
>>>
>>>
>>>
>>> 	at java.lang.Class.forName(Class.java:247)
>>> 	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>> 	at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>
>>>
>>>
>>> 	at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>> 	... 19 more
>>>
>>> java.lang.RuntimeException: Error in configuring object
>>> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>
>>>
>>>
>>> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>>
>>>
>>>
>>> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>> 	at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>> Caused by: java.lang.reflect.InvocationTargetException
>>> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>
>>>
>>>
>>> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>> 	at java.lang.reflect.Method.invoke(Method.java:597)
>>>
>>>
>>>
>>> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>> 	... 5 more
>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>
>>>
>>>
>>> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>> 	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>>
>>>
>>>
>>> 	... 10 more
>>> Caused by: java.lang.reflect.InvocationTargetException
>>> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>
>>>
>>>
>>> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>> 	at java.lang.reflect.Method.invoke(Method.java:597)
>>> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>
>>>
>>>
>>> 	... 13 more
>>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>>> 	at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>> 	... 18 more
>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException:
org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>
>>>
>>>
>>> 	at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>> 	at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>> 	... 18 more
>>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>
>>>
>>>
>>> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>> 	at java.security.AccessController.doPrivileged(Native Method)
>>> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>
>>>
>>>
>>> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>> 	at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>> 	at java.lang.Class.forName0(Native Method)
>>>
>>>
>>>
>>> 	at java.lang.Class.forName(Class.java:247)
>>> 	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>> 	at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>
>>>
>>>
>>> 	at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>> 	... 19 more
>>>
>>> java.lang.RuntimeException: Error in configuring object
>>> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>
>>>
>>>
>>> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>>
>>>
>>>
>>> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>> 	at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>> Caused by: java.lang.reflect.InvocationTargetException
>>> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>
>>>
>>>
>>> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>> 	at java.lang.reflect.Method.invoke(Method.java:597)
>>>
>>>
>>>
>>> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>> 	... 5 more
>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>
>>>
>>>
>>> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>> 	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>>
>>>
>>>
>>> 	... 10 more
>>> Caused by: java.lang.reflect.InvocationTargetException
>>> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>
>>>
>>>
>>> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>> 	at java.lang.reflect.Method.invoke(Method.java:597)
>>> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>
>>>
>>>
>>> 	... 13 more
>>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>>> 	at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>> 	... 18 more
>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException:
org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>
>>>
>>>
>>> 	at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>> 	at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>> 	... 18 more
>>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>
>>>
>>>
>>> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>> 	at java.security.AccessController.doPrivileged(Native Method)
>>> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>
>>>
>>>
>>> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>> 	at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>> 	at java.lang.Class.forName0(Native Method)
>>>
>>>
>>>
>>> 	at java.lang.Class.forName(Class.java:247)
>>> 	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>> 	at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>
>>>
>>>
>>> 	at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>> 	... 19 more
>>> java.lang.RuntimeException: Error in configuring object
>>> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>
>>>
>>>
>>> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>>
>>>
>>>
>>> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>> 	at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>> Caused by: java.lang.reflect.InvocationTargetException
>>> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>
>>>
>>>
>>> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>> 	at java.lang.reflect.Method.invoke(Method.java:597)
>>>
>>>
>>>
>>> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>> 	... 5 more
>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>
>>>
>>>
>>> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>> 	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>>
>>>
>>>
>>> 	... 10 more
>>> Caused by: java.lang.reflect.InvocationTargetException
>>> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>
>>>
>>>
>>> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>> 	at java.lang.reflect.Method.invoke(Method.java:597)
>>> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>
>>>
>>>
>>> 	... 13 more
>>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>>> 	at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>> 	... 18 more
>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException:
org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>
>>>
>>>
>>> 	at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>> 	at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>> 	... 18 more
>>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>
>>>
>>>
>>> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>> 	at java.security.AccessController.doPrivileged(Native Method)
>>> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>
>>>
>>>
>>> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>> 	at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>> 	at java.lang.Class.forName0(Native Method)
>>>
>>>
>>>
>>> 	at java.lang.Class.forName(Class.java:247)
>>> 	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>> 	at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>
>>>
>>>
>>> 	at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>> 	... 19 more
>>>
>>> java.lang.RuntimeException: Error in configuring object
>>> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>
>>>
>>>
>>> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>>
>>>
>>>
>>> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>> 	at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>> Caused by: java.lang.reflect.InvocationTargetException
>>> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>
>>>
>>>
>>> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>> 	at java.lang.reflect.Method.invoke(Method.java:597)
>>>
>>>
>>>
>>> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>> 	... 5 more
>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>
>>>
>>>
>>> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>> 	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>>
>>>
>>>
>>> 	... 10 more
>>> Caused by: java.lang.reflect.InvocationTargetException
>>> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>
>>>
>>>
>>> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>> 	at java.lang.reflect.Method.invoke(Method.java:597)
>>> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>
>>>
>>>
>>> 	... 13 more
>>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>>> 	at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>> 	... 18 more
>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException:
org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>
>>>
>>>
>>> 	at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>> 	at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>> 	... 18 more
>>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>
>>>
>>>
>>> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>> 	at java.security.AccessController.doPrivileged(Native Method)
>>> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>
>>>
>>>
>>> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>> 	at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>> 	at java.lang.Class.forName0(Native Method)
>>>
>>>
>>>
>>> 	at java.lang.Class.forName(Class.java:247)
>>> 	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>> 	at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>
>>>
>>>
>>> 	at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>> 	... 19 more
>>>
>>> java.lang.RuntimeException: Error in configuring object
>>> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>
>>>
>>>
>>> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>>
>>>
>>>
>>> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>> 	at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>> Caused by: java.lang.reflect.InvocationTargetException
>>> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>
>>>
>>>
>>> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>> 	at java.lang.reflect.Method.invoke(Method.java:597)
>>>
>>>
>>>
>>> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>> 	... 5 more
>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>
>>>
>>>
>>> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>> 	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>>
>>>
>>>
>>> 	... 10 more
>>> Caused by: java.lang.reflect.InvocationTargetException
>>> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>
>>>
>>>
>>> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>> 	at java.lang.reflect.Method.invoke(Method.java:597)
>>> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>
>>>
>>>
>>> 	... 13 more
>>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>>> 	at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>> 	... 18 more
>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException:
org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>
>>>
>>>
>>> 	at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>> 	at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>> 	... 18 more
>>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>
>>>
>>>
>>> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>> 	at java.security.AccessController.doPrivileged(Native Method)
>>> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>
>>>
>>>
>>> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>> 	at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>> 	at java.lang.Class.forName0(Native Method)
>>>
>>>
>>>
>>> 	at java.lang.Class.forName(Class.java:247)
>>> 	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>> 	at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>
>>>
>>>
>>> 	at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>> 	... 19 more
>>>
>>> java.lang.RuntimeException: Error in configuring object
>>> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>
>>>
>>>
>>> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>>
>>>
>>>
>>> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>> 	at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>> Caused by: java.lang.reflect.InvocationTargetException
>>> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>
>>>
>>>
>>> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>> 	at java.lang.reflect.Method.invoke(Method.java:597)
>>>
>>>
>>>
>>> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>> 	... 5 more
>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>
>>>
>>>
>>> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>> 	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>>
>>>
>>>
>>> 	... 10 more
>>> Caused by: java.lang.reflect.InvocationTargetException
>>> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>
>>>
>>>
>>> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>> 	at java.lang.reflect.Method.invoke(Method.java:597)
>>> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>
>>>
>>>
>>> 	... 13 more
>>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>>> 	at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>> 	... 18 more
>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException:
org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>
>>>
>>>
>>> 	at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>> 	at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>> 	... 18 more
>>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>
>>>
>>>
>>> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>> 	at java.security.AccessController.doPrivileged(Native Method)
>>> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>
>>>
>>>
>>> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>> 	at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>> 	at java.lang.Class.forName0(Native Method)
>>>
>>>
>>>
>>> 	at java.lang.Class.forName(Class.java:247)
>>> 	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>> 	at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>
>>>
>>>
>>> 	at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>> 	... 19 more
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> On Thu, Jan 21, 2010 at 5:33 PM, John Villa <john.joe.villa@gmail.com>wrote:
>>>
>>>> I am currently using hadoop 0.20.1. When I installed ant I did
>>>> -Dhadoop.version="0.20.0"
>>>> I will try and get you that output but my connection is rough right now
>>>> and I need to do a little port forwarding. I will get it to you when i can.
>>>>
>>>>
>>>>
>>>> On Thu, Jan 21, 2010 at 5:04 PM, Ning Zhang <nzhang@facebook.com>wrote:
>>>>
>>>>> Which hadoop version are you using (you can see it by running 'hadoop
>>>>> version')? Have you specified hadoop.version when you compile Hive? Are
they
>>>>> match?
>>>>>
>>>>> Also can you post the log file found through the Tracking URL when you
>>>>> launch the job (in your example http://master:50030/jobdetails.jsp...)?
>>>>> The log files can be found by click through the mappers/reducers and
at the
>>>>> rightmost column of the mapper/reducer stats.
>>>>>
>>>>>
>>>>> On Jan 21, 2010, at 1:37 PM, John Villa wrote:
>>>>>
>>>>> I did not see any hive jar files within hadoop lib directory. I
>>>>> compiled it using ant and the basic readme.
>>>>>
>>>>> On Thu, Jan 21, 2010 at 4:17 PM, Ning Zhang <nzhang@facebook.com>wrote:
>>>>>
>>>>>> It may be because you have 2  copies of Hive's jar files (e.g., one
in
>>>>>> Hadoop's lib directory and one in Hive's lib directory) and they
are from
>>>>>> different releases. If you have compiled Hive trunk yoruself please
make
>>>>>> sure no Hive's jar files in the Hadoop's directory.
>>>>>>
>>>>>>
>>>>>> On Jan 21, 2010, at 12:51 PM, John Villa wrote:
>>>>>>
>>>>>> Here is what I got from the hive log;
>>>>>> 2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
>>>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>>>> "org.eclipse.core.resources" but it cannot be resolved.
>>>>>> 2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
>>>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>>>> "org.eclipse.core.resources" but it cannot be resolved.
>>>>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>>>> "org.eclipse.core.runtime" but it cannot be resolved.
>>>>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>>>> "org.eclipse.core.runtime" but it cannot be resolved.
>>>>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>>>> "org.eclipse.text" but it cannot be resolved.
>>>>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>>>> "org.eclipse.text" but it cannot be resolved.
>>>>>> 2010-01-21 20:49:18,719 WARN  mapred.JobClient
>>>>>> (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser
>>>>>> for parsing the arguments. Applications should implement Tool for
the same.
>>>>>> 2010-01-21 20:49:55,514 ERROR exec.ExecDriver
>>>>>> (SessionState.java:printError(279)) - Ended Job = job_201001211744_0008
with
>>>>>> errors
>>>>>> 2010-01-21 20:49:55,550 ERROR ql.Driver
>>>>>> (SessionState.java:printError(279)) - FAILED: Execution Error, return
code 2
>>>>>> from org.apache.hadoop.hive.ql.exec.ExecDriver
>>>>>>
>>>>>>
>>>>>> On Thu, Jan 21, 2010 at 3:37 PM, John Villa <john.joe.villa@gmail.com
>>>>>> > wrote:
>>>>>>
>>>>>>> Has anyone seen this error? Any help is appreciated, thanks;
>>>>>>>
>>>>>>> hive> select * from apachelog where host ="64.62.191.114";
>>>>>>> Total MapReduce jobs = 1
>>>>>>> Number of reduce tasks is set to 0 since there's no reduce operator
>>>>>>> Starting Job = job_201001211744_0002, Tracking URL =
>>>>>>> http://master:50030/jobdetails.jsp?jobid=job_201001211744_0002
>>>>>>> Kill Command = /u01/hadoop/bin/../bin/hadoop job
>>>>>>> -Dmapred.job.tracker=master:54311 -kill job_201001211744_0002
>>>>>>> 2010-01-21 07:24:38,198 map = 0%,  reduce =0%
>>>>>>> 2010-01-21 07:25:15,029 map = 100%,  reduce =100%
>>>>>>> Ended Job = job_201001211744_0002 with errors
>>>>>>> FAILED: Execution Error, return code 2 from
>>>>>>> org.apache.hadoop.hive.ql.exec.ExecDriver
>>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>
>>>
>>>
>>
>>
>

Mime
View raw message