Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 1C29A10D28 for ; Thu, 12 Sep 2013 00:40:59 +0000 (UTC) Received: (qmail 56199 invoked by uid 500); 12 Sep 2013 00:40:53 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 56000 invoked by uid 500); 12 Sep 2013 00:40:53 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 55958 invoked by uid 99); 12 Sep 2013 00:40:53 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 12 Sep 2013 00:40:53 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,NORMAL_HTTP_TO_IP,RCVD_IN_DNSWL_LOW,SPF_PASS,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of justlooks@gmail.com designates 209.85.216.175 as permitted sender) Received: from [209.85.216.175] (HELO mail-qc0-f175.google.com) (209.85.216.175) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 12 Sep 2013 00:40:49 +0000 Received: by mail-qc0-f175.google.com with SMTP id v2so5785450qcr.34 for ; Wed, 11 Sep 2013 17:40:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=j+iEFzt339FRzXMUZbVqOb2sPqZFf/ubCuoHX7acEhA=; b=kh3Hl65zghbjKy0LMKeUcDMbnAtXCEio4SS09G/a3nLTNhdNaOufMRLJNdGtSlcR3f 6YzFSY//IRge5vO9qjVohuFmrSxezSTPERc1TDk2Q95PQ2/Hus8Tp0wX42qq8hILbtDb k5Zo7dlhnVbxc2kMSUehlpA4sa1an2HK9FhxFNcLDHvwjHxHMmljjoCuRhZVyip6RqTe BSe9mK6yhpHIjba9xukIW8sSCglmifjzpD5C4I2/XSd/704EjFadvEeupWkMUjCzYcUQ Gb7A3xoLSLoVzhPp73jiCOrWUds/Kzf5GEVgx1qYJEeH0HK2U79zUUxKSBkoGE7mgpT3 V6OA== MIME-Version: 1.0 X-Received: by 10.49.105.1 with SMTP id gi1mr8615730qeb.8.1378946427999; Wed, 11 Sep 2013 17:40:27 -0700 (PDT) Received: by 10.140.30.35 with HTTP; Wed, 11 Sep 2013 17:40:27 -0700 (PDT) In-Reply-To: <06006DDA5A27D541991944AC4117E7A96E288026@szxeml560-mbx.china.huawei.com> References: <06006DDA5A27D541991944AC4117E7A96E288026@szxeml560-mbx.china.huawei.com> Date: Thu, 12 Sep 2013 08:40:27 +0800 Message-ID: Subject: Re: why i can not track the job which i submitted in yarn? From: ch huang To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=047d7b6732f80177a604e624fc11 X-Virus-Checked: Checked by ClamAV on apache.org --047d7b6732f80177a604e624fc11 Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable i already set this option ,this is in my mapred-site.xml,and all my hive job can be see in RM UI mapreduce.framework.name yarn The runtime framework for executing MapReduce jobs. Can be one of local, classic or yarn On Wed, Sep 11, 2013 at 5:51 PM, Devaraj k wrote: > Your Job is running in local mode, that=92s why you don=92t see in the R= M > UI/Job History.**** > > ** ** > > Can you change =91mapreduce.framework.name=92 configuration value to =91y= arn=92, > it will show in RM UI.**** > > ** ** > > Thanks**** > > Devaraj k**** > > ** ** > > *From:* ch huang [mailto:justlooks@gmail.com] > *Sent:* 11 September 2013 15:08 > *To:* user@hadoop.apache.org > *Subject:* why i can not track the job which i submitted in yarn?**** > > ** ** > > hi,all:**** > > i do now know why i can not track my job which submitted to yarn ? *= * > ** > > **** > > # hadoop jar > /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples-2.0.0-cdh4.3.0.jar pi > 20 10**** > > Number of Maps =3D 20 > Samples per Map =3D 10 > Wrote input for Map #0 > Wrote input for Map #1 > Wrote input for Map #2 > Wrote input for Map #3 > Wrote input for Map #4 > Wrote input for Map #5 > Wrote input for Map #6 > Wrote input for Map #7 > Wrote input for Map #8 > Wrote input for Map #9 > Wrote input for Map #10 > Wrote input for Map #11 > Wrote input for Map #12 > Wrote input for Map #13 > Wrote input for Map #14 > Wrote input for Map #15 > Wrote input for Map #16 > Wrote input for Map #17 > Wrote input for Map #18 > Wrote input for Map #19 > Starting Job > 13/09/11 17:32:02 WARN conf.Configuration: session.id is deprecated. > Instead, use dfs.metrics.session-id > 13/09/11 17:32:02 INFO jvm.JvmMetrics: Initializing JVM Metrics with > processName=3DJobTracker, sessionId=3D > 13/09/11 17:32:02 WARN conf.Configuration: slave.host.name is deprecated. > Instead, use dfs.datanode.hostname > 13/09/11 17:32:02 WARN mapred.JobClient: Use GenericOptionsParser for > parsing the arguments. Applications should implement Tool for the same. > 13/09/11 17:32:02 INFO mapred.FileInputFormat: Total input paths to > process : 20 > 13/09/11 17:32:03 INFO mapred.LocalJobRunner: OutputCommitter set in > config null > 13/09/11 17:32:03 INFO mapred.JobClient: Running job: > job_local854997782_0001 > 13/09/11 17:32:03 INFO mapred.LocalJobRunner: OutputCommitter is > org.apache.hadoop.mapred.FileOutputCommitter > 13/09/11 17:32:03 INFO mapred.LocalJobRunner: Waiting for map tasks > 13/09/11 17:32:03 INFO mapred.LocalJobRunner: Starting task: > attempt_local854997782_0001_m_000000_0 > 13/09/11 17:32:03 WARN mapreduce.Counters: Group > org.apache.hadoop.mapred.Task$Counter is deprecated. Use > org.apache.hadoop.mapreduce.TaskCounter instead > 13/09/11 17:32:03 INFO util.ProcessTree: setsid exited with exit code 0 > 13/09/11 17:32:03 INFO mapred.Task: Using ResourceCalculatorPlugin : > org.apache.hadoop.util.LinuxResourceCalculatorPlugin@7f342545 > 13/09/11 17:32:03 INFO mapred.MapTask: Processing split: > hdfs://CH22:9000/user/root/PiEstimator_TMP_3_141592654/in/part0:0+118 > 13/09/11 17:32:03 WARN mapreduce.Counters: Counter name MAP_INPUT_BYTES i= s > deprecated. Use FileInputFormatCounters as group name and BYTES_READ as > counter name instead > 13/09/11 17:32:03 INFO mapred.MapTask: numReduceTasks: 1 > 13/09/11 17:32:03 INFO mapred.MapTask: Map output collector class =3D > org.apache.hadoop.mapred.MapTask$MapOutputBuffer > 13/09/11 17:32:03 INFO mapred.MapTask: io.sort.mb =3D 100 > 13/09/11 17:32:03 INFO mapred.MapTask: data buffer =3D 79691776/99614720 > 13/09/11 17:32:03 INFO mapred.MapTask: record buffer =3D 262144/327680 > 13/09/11 17:32:03 INFO mapred.MapTask: Starting flush of map output > 13/09/11 17:32:03 INFO mapred.MapTask: Finished spill 0 > 13/09/11 17:32:03 INFO mapred.Task: > Task:attempt_local854997782_0001_m_000000_0 is done. And is in the proces= s > of commiting > 13/09/11 17:32:03 INFO mapred.LocalJobRunner: > hdfs://CH22:9000/user/root/PiEstimator_TMP_3_141592654/in/part0:0+118 > 13/09/11 17:32:03 INFO mapred.Task: Task > 'attempt_local854997782_0001_m_000000_0' done. > 13/09/11 17:32:03 INFO mapred.LocalJobRunner: Finishing task: > attempt_local854997782_0001_m_000000_0 > 13/09/11 17:32:03 INFO mapred.LocalJobRunner: Starting task: > attempt_local854997782_0001_m_000001_0 > 13/09/11 17:32:03 WARN mapreduce.Counters: Group > org.apache.hadoop.mapred.Task$Counter is deprecated. Use > org.apache.hadoop.mapreduce.TaskCounter instead > 13/09/11 17:32:03 INFO mapred.Task: Using ResourceCalculatorPlugin : > org.apache.hadoop.util.LinuxResourceCalculatorPlugin@18f63055 > 13/09/11 17:32:03 INFO mapred.MapTask: Processing split: > hdfs://CH22:9000/user/root/PiEstimator_TMP_3_141592654/in/part1:0+118 > 13/09/11 17:32:04 WARN mapreduce.Counters: Counter name MAP_INPUT_BYTES i= s > deprecated. Use FileInputFormatCounters as group name and BYTES_READ as > counter name instead > 13/09/11 17:32:04 INFO mapred.MapTask: numReduceTasks: 1 > 13/09/11 17:32:04 INFO mapred.MapTask: Map output collector class =3D > org.apache.hadoop.mapred.MapTask$MapOutputBuffer > 13/09/11 17:32:04 INFO mapred.MapTask: io.sort.mb =3D 100 > 13/09/11 17:32:04 INFO mapred.MapTask: data buffer =3D 79691776/99614720 > 13/09/11 17:32:04 INFO mapred.MapTask: record buffer =3D 262144/327680 > 13/09/11 17:32:04 INFO mapred.MapTask: Starting flush of map output > 13/09/11 17:32:04 INFO mapred.MapTask: Finished spill 0 > 13/09/11 17:32:04 INFO mapred.Task: > Task:attempt_local854997782_0001_m_000001_0 is done. And is in the proces= s > of commiting > 13/09/11 17:32:04 INFO mapred.LocalJobRunner: > hdfs://CH22:9000/user/root/PiEstimator_TMP_3_141592654/in/part1:0+118 > 13/09/11 17:32:04 INFO mapred.Task: Task > 'attempt_local854997782_0001_m_000001_0' done. > 13/09/11 17:32:04 INFO mapred.LocalJobRunner: Finishing task: > attempt_local854997782_0001_m_000001_0 > 13/09/11 17:32:04 INFO mapred.LocalJobRunner: Starting task: > attempt_local854997782_0001_m_000002_0 > 13/09/11 17:32:04 WARN mapreduce.Counters: Group > org.apache.hadoop.mapred.Task$Counter is deprecated. Use > org.apache.hadoop.mapreduce.TaskCounter instead > 13/09/11 17:32:04 INFO mapred.Task: Using ResourceCalculatorPlugin : > org.apache.hadoop.util.LinuxResourceCalculatorPlugin@74bfd10a > 13/09/11 17:32:04 INFO mapred.MapTask: Processing split: > hdfs://CH22:9000/user/root/PiEstimator_TMP_3_141592654/in/part10:0+118 > 13/09/11 17:32:04 WARN mapreduce.Counters: Counter name MAP_INPUT_BYTES i= s > deprecated. Use FileInputFormatCounters as group name and BYTES_READ as > counter name instead > 13/09/11 17:32:04 INFO mapred.MapTask: numReduceTasks: 1 > 13/09/11 17:32:04 INFO mapred.MapTask: Map output collector class =3D > org.apache.hadoop.mapred.MapTask$MapOutputBuffer > 13/09/11 17:32:04 INFO mapred.MapTask: io.sort.mb =3D 100 > 13/09/11 17:32:04 INFO mapred.MapTask: data buffer =3D 79691776/99614720 > 13/09/11 17:32:04 INFO mapred.MapTask: record buffer =3D 262144/327680 > 13/09/11 17:32:04 INFO mapred.MapTask: Starting flush of map output > 13/09/11 17:32:04 INFO mapred.JobClient: map 10% reduce 0% > 13/09/11 17:32:04 INFO mapred.MapTask: Finished spill 0 > 13/09/11 17:32:04 INFO mapred.Task: > Task:attempt_local854997782_0001_m_000002_0 is done. And is in the proces= s > of commiting > 13/09/11 17:32:04 INFO mapred.LocalJobRunner: > hdfs://CH22:9000/user/root/PiEstimator_TMP_3_141592654/in/part10:0+118 > 13/09/11 17:32:04 INFO mapred.Task: Task > 'attempt_local854997782_0001_m_000002_0' done. > 13/09/11 17:32:04 INFO mapred.LocalJobRunner: Finishing task: > attempt_local854997782_0001_m_000002_0 > 13/09/11 17:32:04 INFO mapred.LocalJobRunner: Starting task: > attempt_local854997782_0001_m_000003_0 > 13/09/11 17:32:04 WARN mapreduce.Counters: Group > org.apache.hadoop.mapred.Task$Counter is deprecated. Use > org.apache.hadoop.mapreduce.TaskCounter instead > 13/09/11 17:32:04 INFO mapred.Task: Using ResourceCalculatorPlugin : > org.apache.hadoop.util.LinuxResourceCalculatorPlugin@3d80a8b7 > 13/09/11 17:32:04 INFO mapred.MapTask: Processing split: > hdfs://CH22:9000/user/root/PiEstimator_TMP_3_141592654/in/part11:0+118 > 13/09/11 17:32:04 WARN mapreduce.Counters: Counter name MAP_INPUT_BYTES i= s > deprecated. Use FileInputFormatCounters as group name and BYTES_READ as > counter name instead > 13/09/11 17:32:04 INFO mapred.MapTask: numReduceTasks: 1 > 13/09/11 17:32:04 INFO mapred.MapTask: Map output collector class =3D > org.apache.hadoop.mapred.MapTask$MapOutputBuffer > 13/09/11 17:32:04 INFO mapred.MapTask: io.sort.mb =3D 100 > 13/09/11 17:32:05 INFO mapred.MapTask: data buffer =3D 79691776/99614720 > 13/09/11 17:32:05 INFO mapred.MapTask: record buffer =3D 262144/327680 > 13/09/11 17:32:05 INFO mapred.MapTask: Starting flush of map output > 13/09/11 17:32:05 INFO mapred.MapTask: Finished spill 0 > 13/09/11 17:32:05 INFO mapred.Task: > Task:attempt_local854997782_0001_m_000003_0 is done. And is in the proces= s > of commiting > 13/09/11 17:32:05 INFO mapred.LocalJobRunner: > hdfs://CH22:9000/user/root/PiEstimator_TMP_3_141592654/in/part11:0+118 > 13/09/11 17:32:05 INFO mapred.Task: Task > 'attempt_local854997782_0001_m_000003_0' done. > 13/09/11 17:32:05 INFO mapred.LocalJobRunner: Finishing task: > attempt_local854997782_0001_m_000003_0 > 13/09/11 17:32:05 INFO mapred.LocalJobRunner: Starting task: > attempt_local854997782_0001_m_000004_0 > 13/09/11 17:32:05 WARN mapreduce.Counters: Group > org.apache.hadoop.mapred.Task$Counter is deprecated. Use > org.apache.hadoop.mapreduce.TaskCounter instead > 13/09/11 17:32:05 INFO mapred.Task: Using ResourceCalculatorPlugin : > org.apache.hadoop.util.LinuxResourceCalculatorPlugin@620e06ce > 13/09/11 17:32:05 INFO mapred.MapTask: Processing split: > hdfs://CH22:9000/user/root/PiEstimator_TMP_3_141592654/in/part12:0+118 > 13/09/11 17:32:05 WARN mapreduce.Counters: Counter name MAP_INPUT_BYTES i= s > deprecated. Use FileInputFormatCounters as group name and BYTES_READ as > counter name instead > 13/09/11 17:32:05 INFO mapred.MapTask: numReduceTasks: 1 > 13/09/11 17:32:05 INFO mapred.MapTask: Map output collector class =3D > org.apache.hadoop.mapred.MapTask$MapOutputBuffer > 13/09/11 17:32:05 INFO mapred.MapTask: io.sort.mb =3D 100 > 13/09/11 17:32:05 INFO mapred.MapTask: data buffer =3D 79691776/99614720 > 13/09/11 17:32:05 INFO mapred.MapTask: record buffer =3D 262144/327680 > 13/09/11 17:32:05 INFO mapred.MapTask: Starting flush of map output > 13/09/11 17:32:05 INFO mapred.MapTask: Finished spill 0 > 13/09/11 17:32:05 INFO mapred.Task: > Task:attempt_local854997782_0001_m_000004_0 is done. And is in the proces= s > of commiting > 13/09/11 17:32:05 INFO mapred.LocalJobRunner: > hdfs://CH22:9000/user/root/PiEstimator_TMP_3_141592654/in/part12:0+118 > 13/09/11 17:32:05 INFO mapred.Task: Task > 'attempt_local854997782_0001_m_000004_0' done. > 13/09/11 17:32:05 INFO mapred.LocalJobRunner: Finishing task: > attempt_local854997782_0001_m_000004_0 > 13/09/11 17:32:05 INFO mapred.LocalJobRunner: Starting task: > attempt_local854997782_0001_m_000005_0 > 13/09/11 17:32:05 WARN mapreduce.Counters: Group > org.apache.hadoop.mapred.Task$Counter is deprecated. Use > org.apache.hadoop.mapreduce.TaskCounter instead > 13/09/11 17:32:05 INFO mapred.Task: Using ResourceCalculatorPlugin : > org.apache.hadoop.util.LinuxResourceCalculatorPlugin@3db158db > 13/09/11 17:32:05 INFO mapred.MapTask: Processing split: > hdfs://CH22:9000/user/root/PiEstimator_TMP_3_141592654/in/part13:0+118 > 13/09/11 17:32:05 WARN mapreduce.Counters: Counter name MAP_INPUT_BYTES i= s > deprecated. Use FileInputFormatCounters as group name and BYTES_READ as > counter name instead > 13/09/11 17:32:05 INFO mapred.MapTask: numReduceTasks: 1 > 13/09/11 17:32:05 INFO mapred.MapTask: Map output collector class =3D > org.apache.hadoop.mapred.MapTask$MapOutputBuffer > 13/09/11 17:32:05 INFO mapred.MapTask: io.sort.mb =3D 100 > 13/09/11 17:32:05 INFO mapred.JobClient: map 25% reduce 0% > 13/09/11 17:32:05 INFO mapred.MapTask: data buffer =3D 79691776/99614720 > 13/09/11 17:32:05 INFO mapred.MapTask: record buffer =3D 262144/327680 > 13/09/11 17:32:05 INFO mapred.MapTask: Starting flush of map output > 13/09/11 17:32:05 INFO mapred.MapTask: Finished spill 0 > 13/09/11 17:32:05 INFO mapred.Task: > Task:attempt_local854997782_0001_m_000005_0 is done. And is in the proces= s > of commiting > 13/09/11 17:32:05 INFO mapred.LocalJobRunner: > hdfs://CH22:9000/user/root/PiEstimator_TMP_3_141592654/in/part13:0+118 > 13/09/11 17:32:05 INFO mapred.Task: Task > 'attempt_local854997782_0001_m_000005_0' done. > 13/09/11 17:32:05 INFO mapred.LocalJobRunner: Finishing task: > attempt_local854997782_0001_m_000005_0 > 13/09/11 17:32:05 INFO mapred.LocalJobRunner: Starting task: > attempt_local854997782_0001_m_000006_0 > 13/09/11 17:32:05 WARN mapreduce.Counters: Group > org.apache.hadoop.mapred.Task$Counter is deprecated. Use > org.apache.hadoop.mapreduce.TaskCounter instead > 13/09/11 17:32:05 INFO mapred.Task: Using ResourceCalculatorPlugin : > org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1819ccba > 13/09/11 17:32:05 INFO mapred.MapTask: Processing split: > hdfs://CH22:9000/user/root/PiEstimator_TMP_3_141592654/in/part14:0+118 > 13/09/11 17:32:05 WARN mapreduce.Counters: Counter name MAP_INPUT_BYTES i= s > deprecated. Use FileInputFormatCounters as group name and BYTES_READ as > counter name instead > 13/09/11 17:32:05 INFO mapred.MapTask: numReduceTasks: 1 > 13/09/11 17:32:05 INFO mapred.MapTask: Map output collector class =3D > org.apache.hadoop.mapred.MapTask$MapOutputBuffer > 13/09/11 17:32:05 INFO mapred.MapTask: io.sort.mb =3D 100 > 13/09/11 17:32:06 INFO mapred.MapTask: data buffer =3D 79691776/99614720 > 13/09/11 17:32:06 INFO mapred.MapTask: record buffer =3D 262144/327680 > 13/09/11 17:32:06 INFO mapred.MapTask: Starting flush of map output > 13/09/11 17:32:06 INFO mapred.MapTask: Finished spill 0 > 13/09/11 17:32:06 INFO mapred.Task: > Task:attempt_local854997782_0001_m_000006_0 is done. And is in the proces= s > of commiting > 13/09/11 17:32:06 INFO mapred.LocalJobRunner: > hdfs://CH22:9000/user/root/PiEstimator_TMP_3_141592654/in/part14:0+118 > 13/09/11 17:32:06 INFO mapred.Task: Task > 'attempt_local854997782_0001_m_000006_0' done. > 13/09/11 17:32:06 INFO mapred.LocalJobRunner: Finishing task: > attempt_local854997782_0001_m_000006_0 > 13/09/11 17:32:06 INFO mapred.LocalJobRunner: Starting task: > attempt_local854997782_0001_m_000007_0 > 13/09/11 17:32:06 WARN mapreduce.Counters: Group > org.apache.hadoop.mapred.Task$Counter is deprecated. Use > org.apache.hadoop.mapreduce.TaskCounter instead > 13/09/11 17:32:06 INFO mapred.Task: Using ResourceCalculatorPlugin : > org.apache.hadoop.util.LinuxResourceCalculatorPlugin@24a09e41 > 13/09/11 17:32:06 INFO mapred.MapTask: Processing split: > hdfs://CH22:9000/user/root/PiEstimator_TMP_3_141592654/in/part15:0+118 > 13/09/11 17:32:06 WARN mapreduce.Counters: Counter name MAP_INPUT_BYTES i= s > deprecated. Use FileInputFormatCounters as group name and BYTES_READ as > counter name instead > 13/09/11 17:32:06 INFO mapred.MapTask: numReduceTasks: 1 > 13/09/11 17:32:06 INFO mapred.MapTask: Map output collector class =3D > org.apache.hadoop.mapred.MapTask$MapOutputBuffer > 13/09/11 17:32:06 INFO mapred.MapTask: io.sort.mb =3D 100 > 13/09/11 17:32:06 INFO mapred.MapTask: data buffer =3D 79691776/99614720 > 13/09/11 17:32:06 INFO mapred.MapTask: record buffer =3D 262144/327680 > 13/09/11 17:32:06 INFO mapred.MapTask: Starting flush of map output > 13/09/11 17:32:06 INFO mapred.MapTask: Finished spill 0 > 13/09/11 17:32:06 INFO mapred.Task: > Task:attempt_local854997782_0001_m_000007_0 is done. And is in the proces= s > of commiting > 13/09/11 17:32:06 INFO mapred.LocalJobRunner: > hdfs://CH22:9000/user/root/PiEstimator_TMP_3_141592654/in/part15:0+118 > 13/09/11 17:32:06 INFO mapred.Task: Task > 'attempt_local854997782_0001_m_000007_0' done. > 13/09/11 17:32:06 INFO mapred.LocalJobRunner: Finishing task: > attempt_local854997782_0001_m_000007_0 > 13/09/11 17:32:06 INFO mapred.LocalJobRunner: Starting task: > attempt_local854997782_0001_m_000008_0 > 13/09/11 17:32:06 WARN mapreduce.Counters: Group > org.apache.hadoop.mapred.Task$Counter is deprecated. Use > org.apache.hadoop.mapreduce.TaskCounter instead > 13/09/11 17:32:06 INFO mapred.Task: Using ResourceCalculatorPlugin : > org.apache.hadoop.util.LinuxResourceCalculatorPlugin@5189f854 > 13/09/11 17:32:06 INFO mapred.MapTask: Processing split: > hdfs://CH22:9000/user/root/PiEstimator_TMP_3_141592654/in/part16:0+118 > 13/09/11 17:32:09 INFO mapred.JobClient: File System Counters > 13/09/11 17:32:09 INFO mapred.JobClient: FILE: Number of bytes > read=3D3425924 > 13/09/11 17:32:09 INFO mapred.JobClient: FILE: Number of bytes > written=3D5096181 > 13/09/11 17:32:09 INFO mapred.JobClient: FILE: Number of read > operations=3D0 > 13/09/11 17:32:09 INFO mapred.JobClient: FILE: Number of large read > operations=3D0 > 13/09/11 17:32:09 INFO mapred.JobClient: FILE: Number of write > operations=3D0 > 13/09/11 17:32:09 INFO mapred.JobClient: HDFS: Number of bytes > read=3D27140 > 13/09/11 17:32:09 INFO mapred.JobClient: HDFS: Number of bytes > written=3D49775 > 13/09/11 17:32:09 INFO mapred.JobClient: HDFS: Number of read > operations=3D1175 > 13/09/11 17:32:09 INFO mapred.JobClient: HDFS: Number of large read > operations=3D0 > 13/09/11 17:32:09 INFO mapred.JobClient: HDFS: Number of write > operations=3D465 > 13/09/11 17:32:09 INFO mapred.JobClient: Map-Reduce Framework > 13/09/11 17:32:09 INFO mapred.JobClient: Map input records=3D20 > 13/09/11 17:32:09 INFO mapred.JobClient: Map output records=3D40 > 13/09/11 17:32:09 INFO mapred.JobClient: Map output bytes=3D360 > 13/09/11 17:32:09 INFO mapred.JobClient: Input split bytes=3D2330 > 13/09/11 17:32:09 INFO mapred.JobClient: Combine input records=3D0 > 13/09/11 17:32:09 INFO mapred.JobClient: Combine output records=3D0 > 13/09/11 17:32:09 INFO mapred.JobClient: Reduce input groups=3D2 > 13/09/11 17:32:09 INFO mapred.JobClient: Reduce shuffle bytes=3D0 > 13/09/11 17:32:09 INFO mapred.JobClient: Reduce input records=3D40 > 13/09/11 17:32:09 INFO mapred.JobClient: Reduce output records=3D0 > 13/09/11 17:32:09 INFO mapred.JobClient: Spilled Records=3D104 > 13/09/11 17:32:09 INFO mapred.JobClient: CPU time spent (ms)=3D0 > 13/09/11 17:32:09 INFO mapred.JobClient: Physical memory (bytes) > snapshot=3D0 > 13/09/11 17:32:09 INFO mapred.JobClient: Virtual memory (bytes) > snapshot=3D0 > 13/09/11 17:32:09 INFO mapred.JobClient: Total committed heap usage > (bytes)=3D9912647680 > 13/09/11 17:32:09 INFO mapred.JobClient: > org.apache.hadoop.mapreduce.lib.input.FileInputFormatCounter > 13/09/11 17:32:09 INFO mapred.JobClient: BYTES_READ=3D480 > Job Finished in 7.269 seconds > Estimated value of Pi is 3.12000000000000000000**** > > **** > > # curl http://192.168.10.22:8088/cluster**** > > **** > > var appsTableData=3D[ > [" href=3D'/cluster/app/application_1376355583846_0142'>application_13763555= 83846_0142","hive","select > page_url,concat_ws(\'...page_url,token(Stage-1)","default","1377143481037= ","1377143541840","FINISHED","SUCCEEDED","
title=3D'100.0'>
ui-corner-all' title=3D'100.0%'>
ui-widget-header ui-corner-left' style=3D'width:100.0%'>
","= href=3D' > http://192.168.10.36/proxy/application_1376355583846_0142/jobhistory/job/= job_1376355583846_0142 > '>History"], > [" href=3D'/cluster/app/application_1376355583846_0122'>application_13763555= 83846_0122","hive","select > page_url,concat_ws(\'...page_url,token(Stage-1)","default","1377139980703= ","1377140027552","FINISHED","SUCCEEDED","
title=3D'100.0'>
ui-corner-all' title=3D'100.0%'>
ui-widget-header ui-corner-left' style=3D'width:100.0%'>
","= href=3D' > http://192.168.10.36/proxy/application_1376355583846_0122/jobhistory/job/= job_1376355583846_0122 > '>History"], > [" href=3D'/cluster/app/application_1376355583846_0186'>application_13763555= 83846_0186","hive","select > page_url,concat_ws(\'...page_url,token(Stage-1)","default","1377159354342= ","1377160027061","KILLED","KILLED","
title=3D'100.0'>
ui-corner-all' title=3D'100.0%'>
ui-widget-header ui-corner-left' style=3D'width:100.0%'>
","= href=3D'http://192.168.10.36/proxy/application_1376355583846_0186/ > '>History"], > [" href=3D'/cluster/app/application_1376355583846_0222'>application_13763555= 83846_0222","root","insert > overwrite table > dump_temp2_page_...10(Stage-1)","default","1377679615558","1377679638915"= ,"FINISHED","SUCCEEDED","
title=3D'100.0'>
ui-corner-all' title=3D'100.0%'>
ui-widget-header ui-corner-left' style=3D'width:100.0%'>
","= href=3D' > http://192.168.10.36/proxy/application_1376355583846_0222/jobhistory/job/= job_1376355583846_0222 > '>History"], > [" href=3D'/cluster/app/application_1376355583846_0115'>application_13763555= 83846_0115","root","select > page_url,concat_ws(\'...page_url,token(Stage-1)","default","1377135476144= ","1377136040644","KILLED","KILLED","
title=3D'100.0'>
ui-corner-all' title=3D'100.0%'>
ui-widget-header ui-corner-left' style=3D'width:100.0%'>
","= href=3D'http://192.168.10.36/proxy/application_1376355583846_0115/ > '>History"], > [" href=3D'/cluster/app/application_1376355583846_0151'>application_13763555= 83846_0151","hive","select > page_url,concat_ws(\'...page_url,token(Stage-1)","default","1377144292944= ","1377144370345","FINISHED","SUCCEEDED","
title=3D'100.0'>
ui-corner-all' title=3D'100.0%'>
ui-widget-header ui-corner-left' style=3D'width:100.0%'>
","= href=3D' > http://192.168.10.36/proxy/application_1376355583846_0151/jobhistory/job/= job_1376355583846_0151 > '>History"], > [" href=3D'/cluster/app/application_1376355583846_0033'>application_13763555= 83846_0033","root","select > cookieid,first_category,count(id...10(Stage-1)","default","1376893476778"= ,"1376893512292","FINISHED","SUCCEEDED","
title=3D'100.0'>
ui-corner-all' title=3D'100.0%'>
ui-widget-header ui-corner-left' style=3D'width:100.0%'>
","= href=3D' > http://192.168.10.36/proxy/application_1376355583846_0033/jobhistory/job/= job_1376355583846_0033 > '>History"],**** > --047d7b6732f80177a604e624fc11 Content-Type: text/html; charset=windows-1252 Content-Transfer-Encoding: quoted-printable
i already set this option ,this is in my mapred-site.xml,and all my hi= ve job can be see in RM UI
=A0
=A0
=A0
<property>
=A0=A0=A0=A0=A0=A0=A0 <name>mapreduce.framework.name</name>
= =A0=A0=A0=A0=A0=A0=A0 <value>yarn</value>
=A0=A0=A0=A0=A0=A0= =A0 <description>The runtime framework for executing MapReduce jobs. = Can be one of local, classic or yarn</description>
</property>


On Wed, Sep 11, 2013 at 5:51 PM, Devaraj k <= devaraj.k@huawei.com> wrote:

Your Job is running in local mo= de, that=92s why you don=92t see in the RM UI/Job History.

=A0

Can you change =91mapreduce.framework.name<= /a>=92 configuration value to =91yarn=92, it will show in RM UI.<= /u>

=A0

Thanks

Devaraj k<= /p>

=A0

From: ch huang [mailto:justlooks@gmail.com]
Sent: 11 September 2013 15:08
To:
user@hadoop.apache.org
Subjec= t: why i can not track the job which i submitted in yarn?=

=A0

hi,all:

=A0=A0=A0=A0 i do now know why i can not track my jo= b which submitted to yarn ?

=A0

# hadoop jar /usr/lib/hadoop-mapreduce/hadoop-mapred= uce-examples-2.0.0-cdh4.3.0.jar pi 20 10

Number of Maps=A0 =3D 20
Samples per Map =3D 10Wrote input for Map #0
Wrote input for Map #1
Wrote input for Map #= 2
Wrote input for Map #3
Wrote input for Map #4
Wrote input for Ma= p #5
Wrote input for Map #6
Wrote input for Map #7
Wrote input for Map #8<= br>Wrote input for Map #9
Wrote input for Map #10
Wrote input for Map= #11
Wrote input for Map #12
Wrote input for Map #13
Wrote input f= or Map #14
Wrote input for Map #15
Wrote input for Map #16
Wrote input for Map #= 17
Wrote input for Map #18
Wrote input for Map #19
Starting Job13/09/11 17:32:02 WARN conf.Configuration: session.id is deprecated. Instead, use dfs.metrics.se= ssion-id
13/09/11 17:32:02 INFO jvm.JvmMetrics: Initializing JVM Metrics with proces= sName=3DJobTracker, sessionId=3D
13/09/11 17:32:02 WARN conf.Configurati= on: slave.host.name is deprecated. Instead, use dfs.datanode.hostname
13/09/11 17:32:02 WARN mapred.JobClient: Use GenericOptionsParser for parsi= ng the arguments. Applications should implement Tool for the same.
13/09= /11 17:32:02 INFO mapred.FileInputFormat: Total input paths to process : 20=
13/09/11 17:32:03 INFO mapred.LocalJobRunner: OutputCommitter set in config= null
13/09/11 17:32:03 INFO mapred.JobClient: Running job: job_local854= 997782_0001
13/09/11 17:32:03 INFO mapred.LocalJobRunner: OutputCommitte= r is org.apache.hadoop.mapred.FileOutputCommitter
13/09/11 17:32:03 INFO mapred.LocalJobRunner: Waiting for map tasks
13/0= 9/11 17:32:03 INFO mapred.LocalJobRunner: Starting task: attempt_local85499= 7782_0001_m_000000_0
13/09/11 17:32:03 WARN mapreduce.Counters: Group or= g.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.ma= preduce.TaskCounter instead
13/09/11 17:32:03 INFO util.ProcessTree: setsid exited with exit code 0
= 13/09/11 17:32:03 INFO mapred.Task:=A0 Using ResourceCalculatorPlugin :
org.apache.hadoop.util.LinuxResourceCalculatorPlugin@7= f342545
13/09/11 17:32:03 INFO mapred.MapTask: Processing split: hdfs://CH22:9000/u= ser/root/PiEstimator_TMP_3_141592654/in/part0:0+118
13/09/11 17:32:03 WA= RN mapreduce.Counters: Counter name MAP_INPUT_BYTES is deprecated. Use File= InputFormatCounters as group name and=A0 BYTES_READ as counter name instead=
13/09/11 17:32:03 INFO mapred.MapTask: numReduceTasks: 1
13/09/11 17:32:= 03 INFO mapred.MapTask: Map output collector class =3D org.apache.hadoop.ma= pred.MapTask$MapOutputBuffer
13/09/11 17:32:03 INFO mapred.MapTask: io.s= ort.mb =3D 100
13/09/11 17:32:03 INFO mapred.MapTask: data buffer =3D 79691776/9961472013/09/11 17:32:03 INFO mapred.MapTask: record buffer =3D 262144/327680
= 13/09/11 17:32:03 INFO mapred.MapTask: Starting flush of map output
13/0= 9/11 17:32:03 INFO mapred.MapTask: Finished spill 0
13/09/11 17:32:03 INFO mapred.Task: Task:attempt_local854997782_0001_m_0000= 00_0 is done. And is in the process of commiting
13/09/11 17:32:03 INFO = mapred.LocalJobRunner: hdfs://CH22:9000/user/root/PiEstimator_TMP_3_1415926= 54/in/part0:0+118
13/09/11 17:32:03 INFO mapred.Task: Task 'attempt_local854997782_0001_m= _000000_0' done.
13/09/11 17:32:03 INFO mapred.LocalJobRunner: Finis= hing task: attempt_local854997782_0001_m_000000_0
13/09/11 17:32:03 INFO= mapred.LocalJobRunner: Starting task: attempt_local854997782_0001_m_000001= _0
13/09/11 17:32:03 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.T= ask$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter inst= ead
13/09/11 17:32:03 INFO mapred.Task:=A0 Using ResourceCalculatorPlugi= n : org.apache.hadoop.util.LinuxResourceCalculatorP= lugin@18f63055
13/09/11 17:32:03 INFO mapred.MapTask: Processing split: hdfs://CH22:9000/u= ser/root/PiEstimator_TMP_3_141592654/in/part1:0+118
13/09/11 17:32:04 WA= RN mapreduce.Counters: Counter name MAP_INPUT_BYTES is deprecated. Use File= InputFormatCounters as group name and=A0 BYTES_READ as counter name instead=
13/09/11 17:32:04 INFO mapred.MapTask: numReduceTasks: 1
13/09/11 17:32:= 04 INFO mapred.MapTask: Map output collector class =3D org.apache.hadoop.ma= pred.MapTask$MapOutputBuffer
13/09/11 17:32:04 INFO mapred.MapTask: io.s= ort.mb =3D 100
13/09/11 17:32:04 INFO mapred.MapTask: data buffer =3D 79691776/9961472013/09/11 17:32:04 INFO mapred.MapTask: record buffer =3D 262144/327680
= 13/09/11 17:32:04 INFO mapred.MapTask: Starting flush of map output
13/0= 9/11 17:32:04 INFO mapred.MapTask: Finished spill 0
13/09/11 17:32:04 INFO mapred.Task: Task:attempt_local854997782_0001_m_0000= 01_0 is done. And is in the process of commiting
13/09/11 17:32:04 INFO = mapred.LocalJobRunner: hdfs://CH22:9000/user/root/PiEstimator_TMP_3_1415926= 54/in/part1:0+118
13/09/11 17:32:04 INFO mapred.Task: Task 'attempt_local854997782_0001_m= _000001_0' done.
13/09/11 17:32:04 INFO mapred.LocalJobRunner: Finis= hing task: attempt_local854997782_0001_m_000001_0
13/09/11 17:32:04 INFO= mapred.LocalJobRunner: Starting task: attempt_local854997782_0001_m_000002= _0
13/09/11 17:32:04 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.T= ask$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter inst= ead
13/09/11 17:32:04 INFO mapred.Task:=A0 Using ResourceCalculatorPlugi= n : org.apache.hadoop.util.LinuxResourceCalculatorP= lugin@74bfd10a
13/09/11 17:32:04 INFO mapred.MapTask: Processing split: hdfs://CH22:9000/u= ser/root/PiEstimator_TMP_3_141592654/in/part10:0+118
13/09/11 17:32:04 W= ARN mapreduce.Counters: Counter name MAP_INPUT_BYTES is deprecated. Use Fil= eInputFormatCounters as group name and=A0 BYTES_READ as counter name instea= d
13/09/11 17:32:04 INFO mapred.MapTask: numReduceTasks: 1
13/09/11 17:32:= 04 INFO mapred.MapTask: Map output collector class =3D org.apache.hadoop.ma= pred.MapTask$MapOutputBuffer
13/09/11 17:32:04 INFO mapred.MapTask: io.s= ort.mb =3D 100
13/09/11 17:32:04 INFO mapred.MapTask: data buffer =3D 79691776/9961472013/09/11 17:32:04 INFO mapred.MapTask: record buffer =3D 262144/327680
= 13/09/11 17:32:04 INFO mapred.MapTask: Starting flush of map output
13/0= 9/11 17:32:04 INFO mapred.JobClient:=A0 map 10% reduce 0%
13/09/11 17:32:04 INFO mapred.MapTask: Finished spill 0
13/09/11 17:32:0= 4 INFO mapred.Task: Task:attempt_local854997782_0001_m_000002_0 is done. An= d is in the process of commiting
13/09/11 17:32:04 INFO mapred.LocalJobR= unner: hdfs://CH22:9000/user/root/PiEstimator_TMP_3_141592654/in/part10:0+1= 18
13/09/11 17:32:04 INFO mapred.Task: Task 'attempt_local854997782_0001_m= _000002_0' done.
13/09/11 17:32:04 INFO mapred.LocalJobRunner: Finis= hing task: attempt_local854997782_0001_m_000002_0
13/09/11 17:32:04 INFO= mapred.LocalJobRunner: Starting task: attempt_local854997782_0001_m_000003= _0
13/09/11 17:32:04 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.T= ask$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter inst= ead
13/09/11 17:32:04 INFO mapred.Task:=A0 Using ResourceCalculatorPlugi= n : org.apache.hadoop.util.LinuxResourceCalculatorP= lugin@3d80a8b7
13/09/11 17:32:04 INFO mapred.MapTask: Processing split: hdfs://CH22:9000/u= ser/root/PiEstimator_TMP_3_141592654/in/part11:0+118
13/09/11 17:32:04 W= ARN mapreduce.Counters: Counter name MAP_INPUT_BYTES is deprecated. Use Fil= eInputFormatCounters as group name and=A0 BYTES_READ as counter name instea= d
13/09/11 17:32:04 INFO mapred.MapTask: numReduceTasks: 1
13/09/11 17:32:= 04 INFO mapred.MapTask: Map output collector class =3D org.apache.hadoop.ma= pred.MapTask$MapOutputBuffer
13/09/11 17:32:04 INFO mapred.MapTask: io.s= ort.mb =3D 100
13/09/11 17:32:05 INFO mapred.MapTask: data buffer =3D 79691776/9961472013/09/11 17:32:05 INFO mapred.MapTask: record buffer =3D 262144/327680
= 13/09/11 17:32:05 INFO mapred.MapTask: Starting flush of map output
13/0= 9/11 17:32:05 INFO mapred.MapTask: Finished spill 0
13/09/11 17:32:05 INFO mapred.Task: Task:attempt_local854997782_0001_m_0000= 03_0 is done. And is in the process of commiting
13/09/11 17:32:05 INFO = mapred.LocalJobRunner: hdfs://CH22:9000/user/root/PiEstimator_TMP_3_1415926= 54/in/part11:0+118
13/09/11 17:32:05 INFO mapred.Task: Task 'attempt_local854997782_0001_m= _000003_0' done.
13/09/11 17:32:05 INFO mapred.LocalJobRunner: Finis= hing task: attempt_local854997782_0001_m_000003_0
13/09/11 17:32:05 INFO= mapred.LocalJobRunner: Starting task: attempt_local854997782_0001_m_000004= _0
13/09/11 17:32:05 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.T= ask$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter inst= ead
13/09/11 17:32:05 INFO mapred.Task:=A0 Using ResourceCalculatorPlugi= n : org.apache.hadoop.util.LinuxResourceCalculatorP= lugin@620e06ce
13/09/11 17:32:05 INFO mapred.MapTask: Processing split: hdfs://CH22:9000/u= ser/root/PiEstimator_TMP_3_141592654/in/part12:0+118
13/09/11 17:32:05 W= ARN mapreduce.Counters: Counter name MAP_INPUT_BYTES is deprecated. Use Fil= eInputFormatCounters as group name and=A0 BYTES_READ as counter name instea= d
13/09/11 17:32:05 INFO mapred.MapTask: numReduceTasks: 1
13/09/11 17:32:= 05 INFO mapred.MapTask: Map output collector class =3D org.apache.hadoop.ma= pred.MapTask$MapOutputBuffer
13/09/11 17:32:05 INFO mapred.MapTask: io.s= ort.mb =3D 100
13/09/11 17:32:05 INFO mapred.MapTask: data buffer =3D 79691776/9961472013/09/11 17:32:05 INFO mapred.MapTask: record buffer =3D 262144/327680
= 13/09/11 17:32:05 INFO mapred.MapTask: Starting flush of map output
13/0= 9/11 17:32:05 INFO mapred.MapTask: Finished spill 0
13/09/11 17:32:05 INFO mapred.Task: Task:attempt_local854997782_0001_m_0000= 04_0 is done. And is in the process of commiting
13/09/11 17:32:05 INFO = mapred.LocalJobRunner: hdfs://CH22:9000/user/root/PiEstimator_TMP_3_1415926= 54/in/part12:0+118
13/09/11 17:32:05 INFO mapred.Task: Task 'attempt_local854997782_0001_m= _000004_0' done.
13/09/11 17:32:05 INFO mapred.LocalJobRunner: Finis= hing task: attempt_local854997782_0001_m_000004_0
13/09/11 17:32:05 INFO= mapred.LocalJobRunner: Starting task: attempt_local854997782_0001_m_000005= _0
13/09/11 17:32:05 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.T= ask$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter inst= ead
13/09/11 17:32:05 INFO mapred.Task:=A0 Using ResourceCalculatorPlugi= n : org.apache.hadoop.util.LinuxResourceCalculatorP= lugin@3db158db
13/09/11 17:32:05 INFO mapred.MapTask: Processing split: hdfs://CH22:9000/u= ser/root/PiEstimator_TMP_3_141592654/in/part13:0+118
13/09/11 17:32:05 W= ARN mapreduce.Counters: Counter name MAP_INPUT_BYTES is deprecated. Use Fil= eInputFormatCounters as group name and=A0 BYTES_READ as counter name instea= d
13/09/11 17:32:05 INFO mapred.MapTask: numReduceTasks: 1
13/09/11 17:32:= 05 INFO mapred.MapTask: Map output collector class =3D org.apache.hadoop.ma= pred.MapTask$MapOutputBuffer
13/09/11 17:32:05 INFO mapred.MapTask: io.s= ort.mb =3D 100
13/09/11 17:32:05 INFO mapred.JobClient:=A0 map 25% reduce 0%
13/09/11 1= 7:32:05 INFO mapred.MapTask: data buffer =3D 79691776/99614720
13/09/11 = 17:32:05 INFO mapred.MapTask: record buffer =3D 262144/327680
13/09/11 1= 7:32:05 INFO mapred.MapTask: Starting flush of map output
13/09/11 17:32:05 INFO mapred.MapTask: Finished spill 0
13/09/11 17:32:0= 5 INFO mapred.Task: Task:attempt_local854997782_0001_m_000005_0 is done. An= d is in the process of commiting
13/09/11 17:32:05 INFO mapred.LocalJobR= unner: hdfs://CH22:9000/user/root/PiEstimator_TMP_3_141592654/in/part13:0+1= 18
13/09/11 17:32:05 INFO mapred.Task: Task 'attempt_local854997782_0001_m= _000005_0' done.
13/09/11 17:32:05 INFO mapred.LocalJobRunner: Finis= hing task: attempt_local854997782_0001_m_000005_0
13/09/11 17:32:05 INFO= mapred.LocalJobRunner: Starting task: attempt_local854997782_0001_m_000006= _0
13/09/11 17:32:05 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.T= ask$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter inst= ead
13/09/11 17:32:05 INFO mapred.Task:=A0 Using ResourceCalculatorPlugi= n : org.apache.hadoop.util.LinuxResourceCalculatorP= lugin@1819ccba
13/09/11 17:32:05 INFO mapred.MapTask: Processing split: hdfs://CH22:9000/u= ser/root/PiEstimator_TMP_3_141592654/in/part14:0+118
13/09/11 17:32:05 W= ARN mapreduce.Counters: Counter name MAP_INPUT_BYTES is deprecated. Use Fil= eInputFormatCounters as group name and=A0 BYTES_READ as counter name instea= d
13/09/11 17:32:05 INFO mapred.MapTask: numReduceTasks: 1
13/09/11 17:32:= 05 INFO mapred.MapTask: Map output collector class =3D org.apache.hadoop.ma= pred.MapTask$MapOutputBuffer
13/09/11 17:32:05 INFO mapred.MapTask: io.s= ort.mb =3D 100
13/09/11 17:32:06 INFO mapred.MapTask: data buffer =3D 79691776/9961472013/09/11 17:32:06 INFO mapred.MapTask: record buffer =3D 262144/327680
= 13/09/11 17:32:06 INFO mapred.MapTask: Starting flush of map output
13/0= 9/11 17:32:06 INFO mapred.MapTask: Finished spill 0
13/09/11 17:32:06 INFO mapred.Task: Task:attempt_local854997782_0001_m_0000= 06_0 is done. And is in the process of commiting
13/09/11 17:32:06 INFO = mapred.LocalJobRunner: hdfs://CH22:9000/user/root/PiEstimator_TMP_3_1415926= 54/in/part14:0+118
13/09/11 17:32:06 INFO mapred.Task: Task 'attempt_local854997782_0001_m= _000006_0' done.
13/09/11 17:32:06 INFO mapred.LocalJobRunner: Finis= hing task: attempt_local854997782_0001_m_000006_0
13/09/11 17:32:06 INFO= mapred.LocalJobRunner: Starting task: attempt_local854997782_0001_m_000007= _0
13/09/11 17:32:06 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.T= ask$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter inst= ead
13/09/11 17:32:06 INFO mapred.Task:=A0 Using ResourceCalculatorPlugi= n : org.apache.hadoop.util.LinuxResourceCalculatorP= lugin@24a09e41
13/09/11 17:32:06 INFO mapred.MapTask: Processing split: hdfs://CH22:9000/u= ser/root/PiEstimator_TMP_3_141592654/in/part15:0+118
13/09/11 17:32:06 W= ARN mapreduce.Counters: Counter name MAP_INPUT_BYTES is deprecated. Use Fil= eInputFormatCounters as group name and=A0 BYTES_READ as counter name instea= d
13/09/11 17:32:06 INFO mapred.MapTask: numReduceTasks: 1
13/09/11 17:32:= 06 INFO mapred.MapTask: Map output collector class =3D org.apache.hadoop.ma= pred.MapTask$MapOutputBuffer
13/09/11 17:32:06 INFO mapred.MapTask: io.s= ort.mb =3D 100
13/09/11 17:32:06 INFO mapred.MapTask: data buffer =3D 79691776/9961472013/09/11 17:32:06 INFO mapred.MapTask: record buffer =3D 262144/327680
= 13/09/11 17:32:06 INFO mapred.MapTask: Starting flush of map output
13/0= 9/11 17:32:06 INFO mapred.MapTask: Finished spill 0
13/09/11 17:32:06 INFO mapred.Task: Task:attempt_local854997782_0001_m_0000= 07_0 is done. And is in the process of commiting
13/09/11 17:32:06 INFO = mapred.LocalJobRunner: hdfs://CH22:9000/user/root/PiEstimator_TMP_3_1415926= 54/in/part15:0+118
13/09/11 17:32:06 INFO mapred.Task: Task 'attempt_local854997782_0001_m= _000007_0' done.
13/09/11 17:32:06 INFO mapred.LocalJobRunner: Finis= hing task: attempt_local854997782_0001_m_000007_0
13/09/11 17:32:06 INFO= mapred.LocalJobRunner: Starting task: attempt_local854997782_0001_m_000008= _0
13/09/11 17:32:06 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.T= ask$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter inst= ead
13/09/11 17:32:06 INFO mapred.Task:=A0 Using ResourceCalculatorPlugi= n : org.apache.hadoop.util.LinuxResourceCalculatorP= lugin@5189f854
13/09/11 17:32:06 INFO mapred.MapTask: Processing split: hdfs://CH22:9000/u= ser/root/PiEstimator_TMP_3_141592654/in/part16:0+118
13/09/11 17:32:09 I= NFO mapred.JobClient:=A0=A0 File System Counters
13/09/11 17:32:09 INFO = mapred.JobClient:=A0=A0=A0=A0 FILE: Number of bytes read=3D3425924
13/09/11 17:32:09 INFO mapred.JobClient:=A0=A0=A0=A0 FILE: Number of bytes = written=3D5096181
13/09/11 17:32:09 INFO mapred.JobClient:=A0=A0=A0=A0 F= ILE: Number of read operations=3D0
13/09/11 17:32:09 INFO mapred.JobClie= nt:=A0=A0=A0=A0 FILE: Number of large read operations=3D0
13/09/11 17:32:09 INFO mapred.JobClient:=A0=A0=A0=A0 FILE: Number of write = operations=3D0
13/09/11 17:32:09 INFO mapred.JobClient:=A0=A0=A0=A0 HDFS= : Number of bytes read=3D27140
13/09/11 17:32:09 INFO mapred.JobClient:= =A0=A0=A0=A0 HDFS: Number of bytes written=3D49775
13/09/11 17:32:09 INFO mapred.JobClient:=A0=A0=A0=A0 HDFS: Number of read o= perations=3D1175
13/09/11 17:32:09 INFO mapred.JobClient:=A0=A0=A0=A0 HD= FS: Number of large read operations=3D0
13/09/11 17:32:09 INFO mapred.Jo= bClient:=A0=A0=A0=A0 HDFS: Number of write operations=3D465
13/09/11 17:32:09 INFO mapred.JobClient:=A0=A0 Map-Reduce Framework
13/0= 9/11 17:32:09 INFO mapred.JobClient:=A0=A0=A0=A0 Map input records=3D20
= 13/09/11 17:32:09 INFO mapred.JobClient:=A0=A0=A0=A0 Map output records=3D4= 0
13/09/11 17:32:09 INFO mapred.JobClient:=A0=A0=A0=A0 Map output bytes= =3D360
13/09/11 17:32:09 INFO mapred.JobClient:=A0=A0=A0=A0 Input split bytes=3D23= 30
13/09/11 17:32:09 INFO mapred.JobClient:=A0=A0=A0=A0 Combine input re= cords=3D0
13/09/11 17:32:09 INFO mapred.JobClient:=A0=A0=A0=A0 Combine o= utput records=3D0
13/09/11 17:32:09 INFO mapred.JobClient:=A0=A0=A0=A0 R= educe input groups=3D2
13/09/11 17:32:09 INFO mapred.JobClient:=A0=A0=A0=A0 Reduce shuffle bytes= =3D0
13/09/11 17:32:09 INFO mapred.JobClient:=A0=A0=A0=A0 Reduce input r= ecords=3D40
13/09/11 17:32:09 INFO mapred.JobClient:=A0=A0=A0=A0 Reduce = output records=3D0
13/09/11 17:32:09 INFO mapred.JobClient:=A0=A0=A0=A0 = Spilled Records=3D104
13/09/11 17:32:09 INFO mapred.JobClient:=A0=A0=A0=A0 CPU time spent (ms)=3D= 0
13/09/11 17:32:09 INFO mapred.JobClient:=A0=A0=A0=A0 Physical memory (= bytes) snapshot=3D0
13/09/11 17:32:09 INFO mapred.JobClient:=A0=A0=A0=A0= Virtual memory (bytes) snapshot=3D0
13/09/11 17:32:09 INFO mapred.JobClient:=A0=A0=A0=A0 Total committed heap u= sage (bytes)=3D9912647680
13/09/11 17:32:09 INFO mapred.JobClient:=A0=A0= org.apache.hadoop.mapreduce.lib.input.FileInputFormatCounter
13/09/11 1= 7:32:09 INFO mapred.JobClient:=A0=A0=A0=A0 BYTES_READ=3D480
Job Finished in 7.269 seconds
Estimated value of Pi is 3.120000000000000= 00000

=A0

# curl http://192.168.10.22:8088/cluster

<= /div>

=A0

=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 var appsTabl= eData=3D[
["<a href=3D'/cluster/app/application_137635558384= 6_0142'>application_1376355583846_0142</a>","hive&qu= ot;,"select page_url,concat_ws(\'...page_url,token(Stage-1)",= "default","1377143481037","1377143541840",&qu= ot;FINISHED","SUCCEEDED","<br title=3D'100.0'= ;> <div class=3D'ui-progressbar ui-widget ui-widget-content ui-co= rner-all' title=3D'100.0%'> <div class=3D'ui-progress= bar-value ui-widget-header ui-corner-left' style=3D'width:100.0%= 9;> </div> </div>","<a href=3D'http://192.168.10.36/proxy/applicati= on_1376355583846_0142/jobhistory/job/job_1376355583846_0142'>His= tory</a>"],
["<a href=3D'/cluster/app/application_1376355583846_0122'&g= t;application_1376355583846_0122</a>","hive","sel= ect page_url,concat_ws(\'...page_url,token(Stage-1)","default= ","1377139980703","1377140027552","FINISHED&q= uot;,"SUCCEEDED","<br title=3D'100.0'> <div= class=3D'ui-progressbar ui-widget ui-widget-content ui-corner-all'= title=3D'100.0%'> <div class=3D'ui-progressbar-value ui-= widget-header ui-corner-left' style=3D'width:100.0%'> </d= iv> </div>","<a href=3D'http://192.168.10.36/proxy/application_1376355583= 846_0122/jobhistory/job/job_1376355583846_0122'>History</a>= ;"],
["<a href=3D'/cluster/app/application_1376355583846_0186'&g= t;application_1376355583846_0186</a>","hive","sel= ect page_url,concat_ws(\'...page_url,token(Stage-1)","default= ","1377159354342","1377160027061","KILLED&quo= t;,"KILLED","<br title=3D'100.0'> <div clas= s=3D'ui-progressbar ui-widget ui-widget-content ui-corner-all' titl= e=3D'100.0%'> <div class=3D'ui-progressbar-value ui-widge= t-header ui-corner-left' style=3D'width:100.0%'> </div>= ; </div>","<a href=3D'http://192.168.1= 0.36/proxy/application_1376355583846_0186/'>History</a>&qu= ot;],
["<a href=3D'/cluster/app/application_1376355583846_0222'&g= t;application_1376355583846_0222</a>","root","ins= ert overwrite table dump_temp2_page_...10(Stage-1)","default"= ;,"1377679615558","1377679638915","FINISHED",= "SUCCEEDED","<br title=3D'100.0'> <div clas= s=3D'ui-progressbar ui-widget ui-widget-content ui-corner-all' titl= e=3D'100.0%'> <div class=3D'ui-progressbar-value ui-widge= t-header ui-corner-left' style=3D'width:100.0%'> </div>= ; </div>","<a href=3D'http://192.168.10.36/proxy/application_1376355583846_0= 222/jobhistory/job/job_1376355583846_0222'>History</a>&quo= t;],
["<a href=3D'/cluster/app/application_1376355583846_0115'&g= t;application_1376355583846_0115</a>","root","sel= ect page_url,concat_ws(\'...page_url,token(Stage-1)","default= ","1377135476144","1377136040644","KILLED&quo= t;,"KILLED","<br title=3D'100.0'> <div clas= s=3D'ui-progressbar ui-widget ui-widget-content ui-corner-all' titl= e=3D'100.0%'> <div class=3D'ui-progressbar-value ui-widge= t-header ui-corner-left' style=3D'width:100.0%'> </div>= ; </div>","<a href=3D'http://192.168.1= 0.36/proxy/application_1376355583846_0115/'>History</a>&qu= ot;],
["<a href=3D'/cluster/app/application_1376355583846_0151'&g= t;application_1376355583846_0151</a>","hive","sel= ect page_url,concat_ws(\'...page_url,token(Stage-1)","default= ","1377144292944","1377144370345","FINISHED&q= uot;,"SUCCEEDED","<br title=3D'100.0'> <div= class=3D'ui-progressbar ui-widget ui-widget-content ui-corner-all'= title=3D'100.0%'> <div class=3D'ui-progressbar-value ui-= widget-header ui-corner-left' style=3D'width:100.0%'> </d= iv> </div>","<a href=3D'http://192.168.10.36/proxy/application_1376355583= 846_0151/jobhistory/job/job_1376355583846_0151'>History</a>= ;"],
["<a href=3D'/cluster/app/application_1376355583846_0033'&g= t;application_1376355583846_0033</a>","root","sel= ect cookieid,first_category,count(id...10(Stage-1)","default"= ;,"1376893476778","1376893512292","FINISHED",= "SUCCEEDED","<br title=3D'100.0'> <div clas= s=3D'ui-progressbar ui-widget ui-widget-content ui-corner-all' titl= e=3D'100.0%'> <div class=3D'ui-progressbar-value ui-widge= t-header ui-corner-left' style=3D'width:100.0%'> </div>= ; </div>","<a href=3D'http://192.168.10.36/proxy/application_1376355583846_0= 033/jobhistory/job/job_1376355583846_0033'>History</a>&quo= t;],


--047d7b6732f80177a604e624fc11--