hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chris Mawata <chris.maw...@gmail.com>
Subject Re: Beginner Hadoop Code
Date Tue, 28 Apr 2015 16:13:09 GMT
Great! Good luck with your exploration.
Chris
On Apr 28, 2015 9:30 AM, "Anand Murali" <anand_vihar@yahoo.com> wrote:

> Many thanks Chris. It works.
>
> Anand Murali
> 11/7, 'Anand Vihar', Kandasamy St, Mylapore
> Chennai - 600 004, India
> Ph: (044)- 28474593/ 43526162 (voicemail)
>
>
>
>   On Tuesday, April 28, 2015 4:53 PM, Chris Mawata <chris.mawata@gmail.com>
> wrote:
>
>
> Looks like the framework is having difficulty instantiating your Mapper.
> The problem is probably because you made it an instance inner class. Make
> it a static nested class
> public static class MaxTemperatureMapper ...
> and the same for your reducer
>
> On Tue, Apr 28, 2015 at 4:27 AM, Anand Murali <anand_vihar@yahoo.com>
> wrote:
>
> Rudra:
>
> Request you to be more specific. Thanks
>
> Anand Murali
> 11/7, 'Anand Vihar', Kandasamy St, Mylapore
> Chennai - 600 004, India
> Ph: (044)- 28474593/ 43526162 (voicemail)
>
>
>
>   On Tuesday, April 28, 2015 1:14 PM, Rudra Tripathy <rudra1in@gmail.com>
> wrote:
>
>
> Please check max temperature format
>  On Apr 28, 2015 12:14 PM, "Anand Murali" <anand_vihar@yahoo.com> wrote:
>
> Dear All:
>
> I slightly modified Hadoop2.2 text book (Hadoop Definitive Guide) to suit
> 2.6. When I run though I get runtime exception.
>
> anand_vihar@Latitude-E5540:~/hadoop-2.6.0/input$ hadoop jar max.jar
> MaxTemperature /user/anand_vihar/max/input output
> 15/04/28 11:46:57 INFO Configuration.deprecation: session.id is
> deprecated. Instead, use dfs.metrics.session-id
> 15/04/28 11:46:57 INFO jvm.JvmMetrics: Initializing JVM Metrics with
> processName=JobTracker, sessionId=
> 15/04/28 11:46:57 WARN mapreduce.JobSubmitter: Hadoop command-line option
> parsing not performed. Implement the Tool interface and execute your
> application with ToolRunner to remedy this.
> 15/04/28 11:46:57 INFO input.FileInputFormat: Total input paths to process
> : 1
> 15/04/28 11:46:57 INFO mapreduce.JobSubmitter: number of splits:1
> 15/04/28 11:46:57 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_local117348325_0001
> 15/04/28 11:46:58 INFO mapreduce.Job: The url to track the job:
> http://localhost:8080/
> 15/04/28 11:46:58 INFO mapreduce.Job: Running job: job_local117348325_0001
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter set in
> config null
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter is
> org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: Waiting for map tasks
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: Starting task:
> attempt_local117348325_0001_m_000000_0
> 15/04/28 11:46:58 INFO mapred.Task:  Using ResourceCalculatorProcessTree :
> [ ]
> 15/04/28 11:46:58 INFO mapred.LocalJobRunner: map task executor complete.
> 15/04/28 11:46:58 WARN mapred.LocalJobRunner: job_local117348325_0001
> java.lang.Exception: java.lang.RuntimeException:
> java.lang.NoSuchMethodException:
> MaxTemperature$MaxTemperatureMapper.<init>()
>     at
> org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
>     at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
> Caused by: java.lang.RuntimeException: java.lang.NoSuchMethodException:
> MaxTemperature$MaxTemperatureMapper.<init>()
>     at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:131)
>     at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:742)
>     at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
>     at
> org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
>     at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>     at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>     at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>     at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>     at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.NoSuchMethodException:
> MaxTemperature$MaxTemperatureMapper.<init>()
>     at java.lang.Class.getConstructor0(Class.java:2892)
>     at java.lang.Class.getDeclaredConstructor(Class.java:2058)
>     at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:125)
>     ... 8 more
> 15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 running
> in uber mode : false
> 15/04/28 11:46:59 INFO mapreduce.Job:  map 0% reduce 0%
> 15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 failed
> with state FAILED due to: NA
> 15/04/28 11:46:59 INFO mapreduce.Job: Counters: 0
>
> The job, mapper and reducer class is packaged in the jar before
> deployment. Can somebody here explain.
>
> Thanks
>
> Anand Murali
> 11/7, 'Anand Vihar', Kandasamy St, Mylapore
> Chennai - 600 004, India
> Ph: (044)- 28474593/ 43526162 (voicemail)
>
>
>
>
>
>
>

Mime
View raw message