hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From <Shreya....@cognizant.com>
Subject Error in configuring object
Date Thu, 15 Sep 2011 09:07:45 GMT

Hi,

 

Main method looks like below:

public static void main(String[] args) {

            

            JobConf conf = new
JobConf(Sentiment_Analysis_Twitter_Driver.class);

            sLogger.setLevel(Level.ALL);

            conf.setOutputKeyClass(Text.class);

            conf.setOutputValueClass(Text.class);

            

            try {

                  cacheStopWordList(conf);

                  cachePositiveWordList(conf);

                  cacheNegativeWordList(conf);

                  cacheSearchList(conf);

            } catch (IOException e1) {

                  // TODO Auto-generated catch block

                  sLogger.error("########copying error");

                  e1.printStackTrace();

            

            }

            

            sLogger.debug("***copied All");

            // TODO: specify input and output DIRECTORIES (not files)

            FileInputFormat.setInputPaths(conf,new
Path("/home/hadoop/sa/input"));

            FileOutputFormat.setOutputPath(conf,new
Path("/home/hadoop/sa/output"));

 

            // TODO: specify a mapper

 
conf.setMapperClass(Sentiment_Analysis_Twitter_mapper.class);

            sLogger.debug("***Set All");

            try {

                  JobClient.runJob(conf); //Error comes here

            } catch (Exception e) {

                  sLogger.error("########error calling run method" +
e.getMessage());

                  e.printStackTrace();

                  

            }

      }

 

Iam trying to run a MR job and get the following error:

java.lang.RuntimeException: Error in configuring object

        at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:9
3)

        at
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)

        at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:
117)

        at
org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:431)

        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:371)

        at org.apache.hadoop.mapred.Child$4.run(Child.java:259)

        at java.security.AccessController.doPrivileged(Native Method)

        at javax.security.auth.Subject.doAs(Subject.java:415)

        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformatio
n.java:1059)

        at org.apache.hadoop.mapred.Child.main(Child.java:253)

Caused by: java.lang.reflect.InvocationTargetException

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.jav
a:57)

        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessor
Impl.java:43)

        at java.lang.reflect.Method.invoke(Method.java:601)

        at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:8
8)

        ... 9 more

Caused by: java.lang.RuntimeException: java.lang.InstantiationException

        at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:
115)

        at
org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)

        ... 14 more

Caused by: java.lang.InstantiationException

        at
sun.reflect.InstantiationExceptionConstructorAccessorImpl.newInstance(In
stantiationExceptionConstructorAccessorImpl.java:48)

        at
java.lang.reflect.Constructor.newInstance(Constructor.java:525)

        at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:
113)

        ... 15 more

 

11/09/15 14:29:00 INFO mapred.JobClient: Task Id :
attempt_201108242019_0003_m_000001_0, Status : FAILED

java.lang.RuntimeException: Error in configuring object

        at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:9
3)

        at
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)

        at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:
117)

        at
org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:431)

        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:371)

        at org.apache.hadoop.mapred.Child$4.run(Child.java:259)

        at java.security.AccessController.doPrivileged(Native Method)

        at javax.security.auth.Subject.doAs(Subject.java:415)

        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformatio
n.java:1059)

        at org.apache.hadoop.mapred.Child.main(Child.java:253)

Caused by: java.lang.reflect.InvocationTargetException

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.jav
a:57)

        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessor
Impl.java:43)

        at java.lang.reflect.Method.invoke(Method.java:601)

        at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:8
8)

        ... 9 more

Caused by: java.lang.RuntimeException: java.lang.InstantiationException

        at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:
115)

        at
org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)

        ... 14 more

Caused by: java.lang.InstantiationException

        at
sun.reflect.InstantiationExceptionConstructorAccessorImpl.newInstance(In
stantiationExceptionConstructorAccessorImpl.java:48)

        at
java.lang.reflect.Constructor.newInstance(Constructor.java:525)

        at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:
113)

        ... 15 more

 

11/09/15 14:29:06 INFO mapred.JobClient: Task Id :
attempt_201108242019_0003_m_000000_1, Status : FAILED

java.lang.RuntimeException: Error in configuring object

        at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:9
3)

        at
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)

        at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:
117)

        at
org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:431)

        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:371)

        at org.apache.hadoop.mapred.Child$4.run(Child.java:259)

        at java.security.AccessController.doPrivileged(Native Method)

        at javax.security.auth.Subject.doAs(Subject.java:415)

        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformatio
n.java:1059)

        at org.apache.hadoop.mapred.Child.main(Child.java:253)

Caused by: java.lang.reflect.InvocationTargetException

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.jav
a:57)

        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessor
Impl.java:43)

        at java.lang.reflect.Method.invoke(Method.java:601)

        at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:8
8)

        ... 9 more

Caused by: java.lang.RuntimeException: java.lang.InstantiationException

        at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:
115)

        at
org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)

        ... 14 more

Caused by: java.lang.InstantiationException

        at
sun.reflect.InstantiationExceptionConstructorAccessorImpl.newInstance(In
stantiationExceptionConstructorAccessorImpl.java:48)

        at
java.lang.reflect.Constructor.newInstance(Constructor.java:525)

        at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:
113)

        ... 15 more

 

11/09/15 14:29:08 INFO mapred.JobClient: Task Id :
attempt_201108242019_0003_m_000001_1, Status : FAILED

java.lang.RuntimeException: Error in configuring object

        at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:9
3)

        at
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)

        at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:
117)

        at
org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:431)

        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:371)

        at org.apache.hadoop.mapred.Child$4.run(Child.java:259)

        at java.security.AccessController.doPrivileged(Native Method)

        at javax.security.auth.Subject.doAs(Subject.java:415)

        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformatio
n.java:1059)

        at org.apache.hadoop.mapred.Child.main(Child.java:253)

Caused by: java.lang.reflect.InvocationTargetException

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.jav
a:57)

        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessor
Impl.java:43)

        at java.lang.reflect.Method.invoke(Method.java:601)

        at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:8
8)

        ... 9 more

Caused by: java.lang.RuntimeException: java.lang.InstantiationException

        at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:
115)

        at
org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)

        ... 14 more

Caused by: java.lang.InstantiationException

        at
sun.reflect.InstantiationExceptionConstructorAccessorImpl.newInstance(In
stantiationExceptionConstructorAccessorImpl.java:48)

        at
java.lang.reflect.Constructor.newInstance(Constructor.java:525)

        at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:
113)

        ... 15 more

 

11/09/15 14:29:12 INFO mapred.JobClient: Task Id :
attempt_201108242019_0003_m_000000_2, Status : FAILED

java.lang.RuntimeException: Error in configuring object

        at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:9
3)

        at
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)

        at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:
117)

        at
org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:431)

        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:371)

        at org.apache.hadoop.mapred.Child$4.run(Child.java:259)

        at java.security.AccessController.doPrivileged(Native Method)

        at javax.security.auth.Subject.doAs(Subject.java:415)

        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformatio
n.java:1059)

        at org.apache.hadoop.mapred.Child.main(Child.java:253)

Caused by: java.lang.reflect.InvocationTargetException

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.jav
a:57)

        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessor
Impl.java:43)

        at java.lang.reflect.Method.invoke(Method.java:601)

        at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:8
8)

        ... 9 more

Caused by: java.lang.RuntimeException: java.lang.InstantiationException

        at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:
115)

        at
org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)

        ... 14 more

Caused by: java.lang.InstantiationException

        at
sun.reflect.InstantiationExceptionConstructorAccessorImpl.newInstance(In
stantiationExceptionConstructorAccessorImpl.java:48)

        at
java.lang.reflect.Constructor.newInstance(Constructor.java:525)

        at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:
113)

        ... 15 more

 

11/09/15 14:29:14 INFO mapred.JobClient: Task Id :
attempt_201108242019_0003_m_000001_2, Status : FAILED

java.lang.RuntimeException: Error in configuring object

        at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:9
3)

        at
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)

        at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:
117)

        at
org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:431)

        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:371)

        at org.apache.hadoop.mapred.Child$4.run(Child.java:259)

        at java.security.AccessController.doPrivileged(Native Method)

        at javax.security.auth.Subject.doAs(Subject.java:415)

        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformatio
n.java:1059)

        at org.apache.hadoop.mapred.Child.main(Child.java:253)

Caused by: java.lang.reflect.InvocationTargetException

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.jav
a:57)

        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessor
Impl.java:43)

        at java.lang.reflect.Method.invoke(Method.java:601)

        at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:8
8)

        ... 9 more

Caused by: java.lang.RuntimeException: java.lang.InstantiationException

        at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:
115)

        at
org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)

        ... 14 more

Caused by: java.lang.InstantiationException

        at
sun.reflect.InstantiationExceptionConstructorAccessorImpl.newInstance(In
stantiationExceptionConstructorAccessorImpl.java:48)

        at
java.lang.reflect.Constructor.newInstance(Constructor.java:525)

        at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:
113)

        ... 15 more

 

11/09/15 14:29:24 INFO mapred.JobClient: Job complete:
job_201108242019_0003

11/09/15 14:29:24 INFO mapred.JobClient: Counters: 7

11/09/15 14:29:24 INFO mapred.JobClient:   Job Counters

11/09/15 14:29:24 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=42792

11/09/15 14:29:24 INFO mapred.JobClient:     Total time spent by all
reduces waiting after reserving slots (ms)=0

11/09/15 14:29:24 INFO mapred.JobClient:     Total time spent by all
maps waiting after reserving slots (ms)=0

11/09/15 14:29:24 INFO mapred.JobClient:     Launched map tasks=8

11/09/15 14:29:24 INFO mapred.JobClient:     Data-local map tasks=8

11/09/15 14:29:24 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=0

11/09/15 14:29:24 INFO mapred.JobClient:     Failed map tasks=1

11/09/15 14:29:24 INFO mapred.JobClient: Job Failed: NA

11/09/15 14:29:24 ERROR sa.Sentiment_Analysis_Twitter_Driver:
########error calling run method Job failed!

java.io.IOException: Job failed!

        at
org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1204)

        at
com.cts.sa.Sentiment_Analysis_Twitter_Driver.main(Sentiment_Analysis_Twi
tter_Driver.java:110)

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.jav
a:57)

        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessor
Impl.java:43)

        at java.lang.reflect.Method.invoke(Method.java:601)

        at org.apache.hadoop.util.RunJar.main(RunJar.java:156)

[hadoop@CTSINGTOHP6 bin]$

 

 



This e-mail and any files transmitted with it are for the sole use of the intended recipient(s)
and may contain confidential and privileged information. If you are not the intended recipient(s),
please reply to the sender and destroy all copies of the original message. Any unauthorized
review, use, disclosure, dissemination, forwarding, printing or copying of this email, and/or
any action taken in reliance on the contents of this e-mail is strictly prohibited and may
be unlawful.
Mime
View raw message