Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 44C9C1772D for ; Tue, 28 Apr 2015 16:13:42 +0000 (UTC) Received: (qmail 80578 invoked by uid 500); 28 Apr 2015 16:13:36 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 80464 invoked by uid 500); 28 Apr 2015 16:13:36 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 80436 invoked by uid 99); 28 Apr 2015 16:13:36 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 28 Apr 2015 16:13:36 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: message received from 54.164.171.186 which is an MX secondary for user@hadoop.apache.org) Received: from [54.164.171.186] (HELO mx1-us-east.apache.org) (54.164.171.186) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 28 Apr 2015 16:13:30 +0000 Received: from mail-yh0-f43.google.com (mail-yh0-f43.google.com [209.85.213.43]) by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) with ESMTPS id B09F243BAD for ; Tue, 28 Apr 2015 16:13:09 +0000 (UTC) Received: by yhda23 with SMTP id a23so26273456yhd.2 for ; Tue, 28 Apr 2015 09:13:09 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=xMvAhVnLLVxx2m2l7OiAfiH8kFIh8RS5uBqpbQPG3n8=; b=IcvolFLT3hfplzxC06aJu2p3NlSckpK7Wt6DgU7OCUyXRcdezEfq9wO/5TS/ZWiAwg 6BcXTdXA/gNyA7/xoGUW8H//hCguvB2ILVYFVsF4z01tTs7ywq63WeVPQqLaZz5KyMz5 EK0Id9g0QlY5uA5g3J9TK2B8udINokQnYdsvoiPr/WKNAGVragRq9tuUZo90QAMcZ1RL rjSnRpQJmthicHWc/Y/qsuEu6GLjn6vnvLJCoAgUNgbGFSRhN9MzJM0pGhJBQFZLfVqp rxgLriEF9UIAcJcYTcEjzoAQKn1BFFDAvBOVYfa87HREj0125MoYP6yWCOWlVoVGtk+n VmvA== MIME-Version: 1.0 X-Received: by 10.170.157.4 with SMTP id y4mr6703231ykc.91.1430237589453; Tue, 28 Apr 2015 09:13:09 -0700 (PDT) Received: by 10.129.10.214 with HTTP; Tue, 28 Apr 2015 09:13:09 -0700 (PDT) Received: by 10.129.10.214 with HTTP; Tue, 28 Apr 2015 09:13:09 -0700 (PDT) In-Reply-To: <818608274.7195550.1430227562036.JavaMail.yahoo@mail.yahoo.com> References: <818608274.7195550.1430227562036.JavaMail.yahoo@mail.yahoo.com> Date: Tue, 28 Apr 2015 12:13:09 -0400 Message-ID: Subject: Re: Beginner Hadoop Code From: Chris Mawata To: Anand Murali , user@hadoop.apache.org Content-Type: multipart/alternative; boundary=001a113a17f676c04d0514cb2304 X-Virus-Checked: Checked by ClamAV on apache.org --001a113a17f676c04d0514cb2304 Content-Type: text/plain; charset=UTF-8 Great! Good luck with your exploration. Chris On Apr 28, 2015 9:30 AM, "Anand Murali" wrote: > Many thanks Chris. It works. > > Anand Murali > 11/7, 'Anand Vihar', Kandasamy St, Mylapore > Chennai - 600 004, India > Ph: (044)- 28474593/ 43526162 (voicemail) > > > > On Tuesday, April 28, 2015 4:53 PM, Chris Mawata > wrote: > > > Looks like the framework is having difficulty instantiating your Mapper. > The problem is probably because you made it an instance inner class. Make > it a static nested class > public static class MaxTemperatureMapper ... > and the same for your reducer > > On Tue, Apr 28, 2015 at 4:27 AM, Anand Murali > wrote: > > Rudra: > > Request you to be more specific. Thanks > > Anand Murali > 11/7, 'Anand Vihar', Kandasamy St, Mylapore > Chennai - 600 004, India > Ph: (044)- 28474593/ 43526162 (voicemail) > > > > On Tuesday, April 28, 2015 1:14 PM, Rudra Tripathy > wrote: > > > Please check max temperature format > On Apr 28, 2015 12:14 PM, "Anand Murali" wrote: > > Dear All: > > I slightly modified Hadoop2.2 text book (Hadoop Definitive Guide) to suit > 2.6. When I run though I get runtime exception. > > anand_vihar@Latitude-E5540:~/hadoop-2.6.0/input$ hadoop jar max.jar > MaxTemperature /user/anand_vihar/max/input output > 15/04/28 11:46:57 INFO Configuration.deprecation: session.id is > deprecated. Instead, use dfs.metrics.session-id > 15/04/28 11:46:57 INFO jvm.JvmMetrics: Initializing JVM Metrics with > processName=JobTracker, sessionId= > 15/04/28 11:46:57 WARN mapreduce.JobSubmitter: Hadoop command-line option > parsing not performed. Implement the Tool interface and execute your > application with ToolRunner to remedy this. > 15/04/28 11:46:57 INFO input.FileInputFormat: Total input paths to process > : 1 > 15/04/28 11:46:57 INFO mapreduce.JobSubmitter: number of splits:1 > 15/04/28 11:46:57 INFO mapreduce.JobSubmitter: Submitting tokens for job: > job_local117348325_0001 > 15/04/28 11:46:58 INFO mapreduce.Job: The url to track the job: > http://localhost:8080/ > 15/04/28 11:46:58 INFO mapreduce.Job: Running job: job_local117348325_0001 > 15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter set in > config null > 15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitter is > org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter > 15/04/28 11:46:58 INFO mapred.LocalJobRunner: Waiting for map tasks > 15/04/28 11:46:58 INFO mapred.LocalJobRunner: Starting task: > attempt_local117348325_0001_m_000000_0 > 15/04/28 11:46:58 INFO mapred.Task: Using ResourceCalculatorProcessTree : > [ ] > 15/04/28 11:46:58 INFO mapred.LocalJobRunner: map task executor complete. > 15/04/28 11:46:58 WARN mapred.LocalJobRunner: job_local117348325_0001 > java.lang.Exception: java.lang.RuntimeException: > java.lang.NoSuchMethodException: > MaxTemperature$MaxTemperatureMapper.() > at > org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462) > at > org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522) > Caused by: java.lang.RuntimeException: java.lang.NoSuchMethodException: > MaxTemperature$MaxTemperatureMapper.() > at > org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:131) > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:742) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) > at > org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) > Caused by: java.lang.NoSuchMethodException: > MaxTemperature$MaxTemperatureMapper.() > at java.lang.Class.getConstructor0(Class.java:2892) > at java.lang.Class.getDeclaredConstructor(Class.java:2058) > at > org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:125) > ... 8 more > 15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 running > in uber mode : false > 15/04/28 11:46:59 INFO mapreduce.Job: map 0% reduce 0% > 15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001 failed > with state FAILED due to: NA > 15/04/28 11:46:59 INFO mapreduce.Job: Counters: 0 > > The job, mapper and reducer class is packaged in the jar before > deployment. Can somebody here explain. > > Thanks > > Anand Murali > 11/7, 'Anand Vihar', Kandasamy St, Mylapore > Chennai - 600 004, India > Ph: (044)- 28474593/ 43526162 (voicemail) > > > > > > > --001a113a17f676c04d0514cb2304 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable

Great! Good luck with your exploration.
Chris

On Apr 28, 2015 9:30 AM, "Anand Murali"= ; <anand_vihar@yahoo.com>= ; wrote:
Many thanks= Chris. It works.
=C2=A0
Anand Murali=C2=A0=C2=A0
<= font size=3D"2">11/7, 'Anand Vihar', Kandasamy St, Mylapore<= /div>
Chennai - 600 004, India
Ph: (044)- 28474593/=C2=A043526162 (voicemail)



= On Tuesday, April 28, 2015 4:53 PM, Chris = Mawata <chri= s.mawata@gmail.com> wrote:


Looks like the framework is having difficulty instantia= ting your Mapper. The problem is probably because you made it an instance i= nner class. Make it a static nested class
public static class MaxTemper= atureMapper ...
and the same for your reducer

On Tue, Apr 28, 2015 at 4:27 AM, Anand Murali <anand_vihar@yahoo.com> wro= te:
Rudra:

Request you to be more specific. Thanks
=C2=A0
Anand Murali=C2=A0=C2=A0
= 11/7, 'Anand Vihar', Kandasamy St, Mylapore=
Chennai - 600 004, India
Ph: (044)- 28474593/=C2=A043526162 (voicemail)



=
On Tuesday, April 28, 2015 1:14 PM, Rudra Tripathy <rudra1in@gmail.com> wrote:
=

Ple= ase check max temperature format
On Apr 28, 2015 12:14 PM, "Anand Murali" <anand_vihar@yahoo.com> wrote:
=
= Dear All:

I slightly mo= dified Hadoop2.2 text book (Hadoop Definitive Guide) to suit 2.6. When I ru= n though I get runtime exception.

=
anand_vihar@Latitude-E5540:~/hadoop-2.6.0/input$ had= oop jar max.jar MaxTemperature /user/anand_vihar/max/input output
15/04/28 11:46:57 INFO Configuration.deprecation: session.i= d is deprecated. Instead, use dfs.metrics.session-id
= 15/04/28 11:46:57 INFO jvm.JvmMetrics: Initializing JVM Metrics with proces= sName=3DJobTracker, sessionId=3D
15/04/28 11:46:57 WARN m= apreduce.JobSubmitter: Hadoop command-line option parsing not performed. Im= plement the Tool interface and execute your application with ToolRunner to = remedy this.
15/04/28 11:46:57 INFO input.FileInputFormat= : Total input paths to process : 1
15/04/28 11:46:57 INFO= mapreduce.JobSubmitter: number of splits:1
15/04/28 11:4= 6:57 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_local11734= 8325_0001
15/04/28 11:46:58 INFO mapreduce.Job: The url t= o track the job: http://localhost:8080/
15/= 04/28 11:46:58 INFO mapreduce.Job: Running job: job_local117348325_0001
15/04/28 11:46:58 INFO mapred.LocalJobRunner: OutputCommitte= r set in config null
15/04/28 11:46:58 INFO mapred.LocalJ= obRunner: OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOut= putCommitter
15/04/28 11:46:58 INFO mapred.LocalJobRunner= : Waiting for map tasks
15/04/28 11:46:58 INFO mapred.Loc= alJobRunner: Starting task: attempt_local117348325_0001_m_000000_0
15/04/28 11:46:58 INFO mapred.Task:=C2=A0 Using ResourceCalculato= rProcessTree : [ ]
15/04/28 11:46:58 INFO mapred.LocalJob= Runner: map task executor complete.
15/04/28 11:46:58 WAR= N mapred.LocalJobRunner: job_local117348325_0001
java.lan= g.Exception: java.lang.RuntimeException: java.lang.NoSuchMethodException: M= axTemperature$MaxTemperatureMapper.<init>()
=C2=A0= =C2=A0=C2=A0 at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJ= obRunner.java:462)
=C2=A0=C2=A0=C2=A0 at org.apache.hadoo= p.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
= Caused by: java.lang.RuntimeException: java.lang.NoSuchMethodException: Max= Temperature$MaxTemperatureMapper.<init>()
=C2=A0=C2= =A0=C2=A0 at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionU= tils.java:131)
=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.ma= pred.MapTask.runNewMapper(MapTask.java:742)
=C2=A0=C2=A0= =C2=A0 at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.mapred.LocalJobRunner$Job= $MapTaskRunnable.run(LocalJobRunner.java:243)
=C2=A0=C2= =A0=C2=A0 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.= java:471)
=C2=A0=C2=A0=C2=A0 at java.util.concurrent.Futu= reTask.run(FutureTask.java:262)
=C2=A0=C2=A0=C2=A0 at jav= a.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145= )
=C2=A0=C2=A0=C2=A0 at java.util.concurrent.ThreadPoolEx= ecutor$Worker.run(ThreadPoolExecutor.java:615)
=C2=A0=C2= =A0=C2=A0 at java.lang.Thread.run(Thread.java:745)
Caused= by: java.lang.NoSuchMethodException: MaxTemperature$MaxTemperatureMapper.&= lt;init>()
=C2=A0=C2=A0=C2=A0 at java.lang.Class.getCo= nstructor0(Class.java:2892)
=C2=A0=C2=A0=C2=A0 at java.la= ng.Class.getDeclaredConstructor(Class.java:2058)
=C2=A0= =C2=A0=C2=A0 at org.apache.hadoop.util.ReflectionUtils.newInstance(Reflecti= onUtils.java:125)
=C2=A0=C2=A0=C2=A0 ... 8 more
15/04/28 11:46:59 INFO mapreduce.Job: Job job_local117348325_0001= running in uber mode : false
15/04/28 11:46:59 INFO mapr= educe.Job:=C2=A0 map 0% reduce 0%
15/04/28 11:46:59 INFO = mapreduce.Job: Job job_local117348325_0001 failed with state FAILED due to:= NA
15/04/28 11:46:59 INFO mapreduce.Job: Counters: 0

The job, mapper and reducer class is packaged in the jar before deploy= ment. Can somebody here explain.

<= /div>
Thanks
=C2=A0
Anand Mural= i=C2=A0=C2=A0
11/7, 'Anand Vihar'= , Kandasamy St, Mylapore
Chennai - 600 00= 4, India
Ph: (044)- 28474593/=C2=A0435261= 62 (voicemail)


<= /div>



--001a113a17f676c04d0514cb2304--