hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: Error in configuring object
Date Thu, 15 Sep 2011 10:13:08 GMT
Hello Shreya,

Looks like the tasks are failing when they try to get the Mapper class
(Sentiment_Analysis_Twitter_mapper.class) instantiated. Possibly something
you might be doing in its empty constructor? Hard to tell without looking at
the mapper class since that doesn't seem to be attached.

On Thu, Sep 15, 2011 at 2:37 PM, <Shreya.Pal@cognizant.com> wrote:

> Hi,****
>
> ** **
>
> Main method looks like below:****
>
> *public* *static* *void* main(String[] args) {****
>
>             ****
>
>             JobConf conf = *new*JobConf(Sentiment_Analysis_Twitter_Driver.
> *class*);****
>
>             *sLogger*.setLevel(Level.*ALL*);****
>
>             conf.setOutputKeyClass(Text.*class*);****
>
>             conf.setOutputValueClass(Text.*class*);****
>
>             ****
>
>             *try* {****
>
>                   *cacheStopWordList*(conf);****
>
>                   *cachePositiveWordList*(conf);****
>
>                   *cacheNegativeWordList*(conf);****
>
>                   *cacheSearchList*(conf);****
>
>             } *catch* (IOException e1) {****
>
>                   // *TODO* Auto-generated catch block****
>
>                   *sLogger*.error("########copying error");****
>
>                   e1.printStackTrace();****
>
>             ****
>
>             }****
>
>             ****
>
>             *sLogger*.debug("***copied All");****
>
>             // *TODO*: specify input and output DIRECTORIES (not files)***
> *
>
>             FileInputFormat.*setInputPaths*(conf,*new* Path(
> "/home/hadoop/sa/input"));****
>
>             FileOutputFormat.*setOutputPath*(conf,*new* Path(
> "/home/hadoop/sa/output"));****
>
> ** **
>
>             // *TODO*: specify a *mapper*****
>
>             conf.setMapperClass(Sentiment_Analysis_Twitter_mapper.*class*
> );****
>
>             *sLogger*.debug("***Set All");****
>
>             *try* {****
>
>                   JobClient.*runJob*(conf); //Error comes here****
>
>             } *catch* (Exception e) {****
>
>                   *sLogger*.error("########error calling run method" +
> e.getMessage());****
>
>                   e.printStackTrace();****
>
>                   ****
>
>             }****
>
>       }****
>
> ** **
>
> Iam trying to run a MR job and get the following error:****
>
> java.lang.RuntimeException: Error in configuring object****
>
>         at
> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> ****
>
>         at
> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)***
> *
>
>         at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> ****
>
>         at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:431)
> ****
>
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:371)****
>
>         at org.apache.hadoop.mapred.Child$4.run(Child.java:259)****
>
>         at java.security.AccessController.doPrivileged(Native Method)****
>
>         at javax.security.auth.Subject.doAs(Subject.java:415)****
>
>         at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
> ****
>
>         at org.apache.hadoop.mapred.Child.main(Child.java:253)****
>
> Caused by: java.lang.reflect.InvocationTargetException****
>
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)****
>
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> ****
>
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> ****
>
>         at java.lang.reflect.Method.invoke(Method.java:601)****
>
>         at
> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> ****
>
>         ... 9 more****
>
> Caused by: java.lang.RuntimeException: java.lang.InstantiationException***
> *
>
>         at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:115)
> ****
>
>         at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
> ****
>
>         ... 14 more****
>
> Caused by: java.lang.InstantiationException****
>
>         at
> sun.reflect.InstantiationExceptionConstructorAccessorImpl.newInstance(InstantiationExceptionConstructorAccessorImpl.java:48)
> ****
>
>         at java.lang.reflect.Constructor.newInstance(Constructor.java:525)
> ****
>
>         at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:113)
> ****
>
>         ... 15 more****
>
> ** **
>
> 11/09/15 14:29:00 INFO mapred.JobClient: Task Id :
> attempt_201108242019_0003_m_000001_0, Status : FAILED****
>
> java.lang.RuntimeException: Error in configuring object****
>
>         at
> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> ****
>
>         at
> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)***
> *
>
>         at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> ****
>
>         at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:431)
> ****
>
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:371)****
>
>         at org.apache.hadoop.mapred.Child$4.run(Child.java:259)****
>
>         at java.security.AccessController.doPrivileged(Native Method)****
>
>         at javax.security.auth.Subject.doAs(Subject.java:415)****
>
>         at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
> ****
>
>         at org.apache.hadoop.mapred.Child.main(Child.java:253)****
>
> Caused by: java.lang.reflect.InvocationTargetException****
>
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)****
>
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> ****
>
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> ****
>
>         at java.lang.reflect.Method.invoke(Method.java:601)****
>
>         at
> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> ****
>
>         ... 9 more****
>
> Caused by: java.lang.RuntimeException: java.lang.InstantiationException***
> *
>
>         at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:115)
> ****
>
>         at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
> ****
>
>         ... 14 more****
>
> Caused by: java.lang.InstantiationException****
>
>         at
> sun.reflect.InstantiationExceptionConstructorAccessorImpl.newInstance(InstantiationExceptionConstructorAccessorImpl.java:48)
> ****
>
>         at java.lang.reflect.Constructor.newInstance(Constructor.java:525)
> ****
>
>         at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:113)
> ****
>
>         ... 15 more****
>
> ** **
>
> 11/09/15 14:29:06 INFO mapred.JobClient: Task Id :
> attempt_201108242019_0003_m_000000_1, Status : FAILED****
>
> java.lang.RuntimeException: Error in configuring object****
>
>         at
> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> ****
>
>         at
> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)***
> *
>
>         at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> ****
>
>         at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:431)
> ****
>
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:371)****
>
>         at org.apache.hadoop.mapred.Child$4.run(Child.java:259)****
>
>         at java.security.AccessController.doPrivileged(Native Method)****
>
>         at javax.security.auth.Subject.doAs(Subject.java:415)****
>
>         at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
> ****
>
>         at org.apache.hadoop.mapred.Child.main(Child.java:253)****
>
> Caused by: java.lang.reflect.InvocationTargetException****
>
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)****
>
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> ****
>
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> ****
>
>         at java.lang.reflect.Method.invoke(Method.java:601)****
>
>         at
> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> ****
>
>         ... 9 more****
>
> Caused by: java.lang.RuntimeException: java.lang.InstantiationException***
> *
>
>         at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:115)
> ****
>
>         at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
> ****
>
>         ... 14 more****
>
> Caused by: java.lang.InstantiationException****
>
>         at
> sun.reflect.InstantiationExceptionConstructorAccessorImpl.newInstance(InstantiationExceptionConstructorAccessorImpl.java:48)
> ****
>
>         at java.lang.reflect.Constructor.newInstance(Constructor.java:525)
> ****
>
>         at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:113)
> ****
>
>         ... 15 more****
>
> ** **
>
> 11/09/15 14:29:08 INFO mapred.JobClient: Task Id :
> attempt_201108242019_0003_m_000001_1, Status : FAILED****
>
> java.lang.RuntimeException: Error in configuring object****
>
>         at
> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> ****
>
>         at
> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)***
> *
>
>         at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> ****
>
>         at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:431)
> ****
>
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:371)****
>
>         at org.apache.hadoop.mapred.Child$4.run(Child.java:259)****
>
>         at java.security.AccessController.doPrivileged(Native Method)****
>
>         at javax.security.auth.Subject.doAs(Subject.java:415)****
>
>         at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
> ****
>
>         at org.apache.hadoop.mapred.Child.main(Child.java:253)****
>
> Caused by: java.lang.reflect.InvocationTargetException****
>
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)****
>
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> ****
>
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> ****
>
>         at java.lang.reflect.Method.invoke(Method.java:601)****
>
>         at
> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> ****
>
>         ... 9 more****
>
> Caused by: java.lang.RuntimeException: java.lang.InstantiationException***
> *
>
>         at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:115)
> ****
>
>         at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
> ****
>
>         ... 14 more****
>
> Caused by: java.lang.InstantiationException****
>
>         at
> sun.reflect.InstantiationExceptionConstructorAccessorImpl.newInstance(InstantiationExceptionConstructorAccessorImpl.java:48)
> ****
>
>         at java.lang.reflect.Constructor.newInstance(Constructor.java:525)
> ****
>
>         at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:113)
> ****
>
>         ... 15 more****
>
> ** **
>
> 11/09/15 14:29:12 INFO mapred.JobClient: Task Id :
> attempt_201108242019_0003_m_000000_2, Status : FAILED****
>
> java.lang.RuntimeException: Error in configuring object****
>
>         at
> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> ****
>
>         at
> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)***
> *
>
>         at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> ****
>
>         at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:431)
> ****
>
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:371)****
>
>         at org.apache.hadoop.mapred.Child$4.run(Child.java:259)****
>
>         at java.security.AccessController.doPrivileged(Native Method)****
>
>         at javax.security.auth.Subject.doAs(Subject.java:415)****
>
>         at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
> ****
>
>         at org.apache.hadoop.mapred.Child.main(Child.java:253)****
>
> Caused by: java.lang.reflect.InvocationTargetException****
>
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)****
>
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> ****
>
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> ****
>
>         at java.lang.reflect.Method.invoke(Method.java:601)****
>
>         at
> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> ****
>
>         ... 9 more****
>
> Caused by: java.lang.RuntimeException: java.lang.InstantiationException***
> *
>
>         at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:115)
> ****
>
>         at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
> ****
>
>         ... 14 more****
>
> Caused by: java.lang.InstantiationException****
>
>         at
> sun.reflect.InstantiationExceptionConstructorAccessorImpl.newInstance(InstantiationExceptionConstructorAccessorImpl.java:48)
> ****
>
>         at java.lang.reflect.Constructor.newInstance(Constructor.java:525)
> ****
>
>         at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:113)
> ****
>
>         ... 15 more****
>
> ** **
>
> 11/09/15 14:29:14 INFO mapred.JobClient: Task Id :
> attempt_201108242019_0003_m_000001_2, Status : FAILED****
>
> java.lang.RuntimeException: Error in configuring object****
>
>         at
> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> ****
>
>         at
> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)***
> *
>
>         at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> ****
>
>         at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:431)
> ****
>
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:371)****
>
>         at org.apache.hadoop.mapred.Child$4.run(Child.java:259)****
>
>         at java.security.AccessController.doPrivileged(Native Method)****
>
>         at javax.security.auth.Subject.doAs(Subject.java:415)****
>
>         at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
> ****
>
>         at org.apache.hadoop.mapred.Child.main(Child.java:253)****
>
> Caused by: java.lang.reflect.InvocationTargetException****
>
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)****
>
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> ****
>
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> ****
>
>         at java.lang.reflect.Method.invoke(Method.java:601)****
>
>         at
> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> ****
>
>         ... 9 more****
>
> Caused by: java.lang.RuntimeException: java.lang.InstantiationException***
> *
>
>         at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:115)
> ****
>
>         at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
> ****
>
>         ... 14 more****
>
> Caused by: java.lang.InstantiationException****
>
>         at
> sun.reflect.InstantiationExceptionConstructorAccessorImpl.newInstance(InstantiationExceptionConstructorAccessorImpl.java:48)
> ****
>
>         at java.lang.reflect.Constructor.newInstance(Constructor.java:525)
> ****
>
>         at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:113)
> ****
>
>         ... 15 more****
>
> ** **
>
> 11/09/15 14:29:24 INFO mapred.JobClient: Job complete:
> job_201108242019_0003****
>
> 11/09/15 14:29:24 INFO mapred.JobClient: Counters: 7****
>
> 11/09/15 14:29:24 INFO mapred.JobClient:   Job Counters****
>
> 11/09/15 14:29:24 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=42792****
>
> 11/09/15 14:29:24 INFO mapred.JobClient:     Total time spent by all
> reduces waiting after reserving slots (ms)=0****
>
> 11/09/15 14:29:24 INFO mapred.JobClient:     Total time spent by all maps
> waiting after reserving slots (ms)=0****
>
> 11/09/15 14:29:24 INFO mapred.JobClient:     Launched map tasks=8****
>
> 11/09/15 14:29:24 INFO mapred.JobClient:     Data-local map tasks=8****
>
> 11/09/15 14:29:24 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=0****
>
> 11/09/15 14:29:24 INFO mapred.JobClient:     Failed map tasks=1****
>
> 11/09/15 14:29:24 INFO mapred.JobClient: Job Failed: NA****
>
> 11/09/15 14:29:24 ERROR sa.Sentiment_Analysis_Twitter_Driver: ########error
> calling run method Job failed!****
>
> java.io.IOException: Job failed!****
>
>         at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1204)*
> ***
>
>         at
> com.cts.sa.Sentiment_Analysis_Twitter_Driver.main(Sentiment_Analysis_Twitter_Driver.java:110)
> ****
>
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)****
>
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> ****
>
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> ****
>
>         at java.lang.reflect.Method.invoke(Method.java:601)****
>
>         at org.apache.hadoop.util.RunJar.main(RunJar.java:156)****
>
> [hadoop@CTSINGTOHP6 bin]$****
>
> ** **
>
> ** **
> This e-mail and any files transmitted with it are for the sole use of the
> intended recipient(s) and may contain confidential and privileged
> information. If you are not the intended recipient(s), please reply to the
> sender and destroy all copies of the original message. Any unauthorized
> review, use, disclosure, dissemination, forwarding, printing or copying of
> this email, and/or any action taken in reliance on the contents of this
> e-mail is strictly prohibited and may be unlawful.
>



-- 
Harsh J

Mime
View raw message