Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2A87C10A39 for ; Thu, 29 Aug 2013 14:53:27 +0000 (UTC) Received: (qmail 14942 invoked by uid 500); 29 Aug 2013 14:53:21 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 14804 invoked by uid 500); 29 Aug 2013 14:53:20 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 14797 invoked by uid 99); 29 Aug 2013 14:53:20 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 29 Aug 2013 14:53:20 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,NORMAL_HTTP_TO_IP,RCVD_IN_DNSWL_LOW,SPF_PASS,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of akelpe@concurrentinc.com designates 209.85.220.179 as permitted sender) Received: from [209.85.220.179] (HELO mail-vc0-f179.google.com) (209.85.220.179) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 29 Aug 2013 14:53:13 +0000 Received: by mail-vc0-f179.google.com with SMTP id ht10so383174vcb.38 for ; Thu, 29 Aug 2013 07:52:52 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=concurrentinc.com; s=google; h=mime-version:date:message-id:subject:from:to:content-type; bh=4GGh9fYK+LFJRXSjdph5xxcrhXtTqhj8pcjRqTDRyeQ=; b=wII7xMvmQiCcBrUV0d46dKEh2rRfUNU3+AQHvv1Y6ni9AnyESnVyICMC2QexzQK1MD TmhKTHUkLvkyjcLC1ar+l/7xJCQjubxw3S9+x9ReeM1pdO8pe2V7tDlDDE39GYgs0Nkx 9peHi70drkTzc+omM6fD1zJqq6uvZ14lp4Ttw= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:date:message-id:subject:from:to :content-type; bh=4GGh9fYK+LFJRXSjdph5xxcrhXtTqhj8pcjRqTDRyeQ=; b=QHMoe/6MDHahGXrsPbfji1nadXu3e+zS9YxoqjuAhdpkXZk9RzhFn1ncKE0w6yuti1 QaptLHtpZiPU9DyDVC8TfTU5ZhA539qVTLofOMxo8jg4L2mFyYmXlDWHfH01VpxYjBM3 G1g9Bpvyb01Qpj81JByK06DL1BbNISkLYrKS+NkU+fPX8+EnW2dHTylGx1klaEKSXpjD bmw4MzwUiDwCpgBFbCZdzjXuX/JyUITLYpQzONJ4QXr/k4swSyzb8bEkw4XuWWcL0Rfu Lqd4p3eecJYy40eY9hmAK1GIYgt9Z1rqMKJdmnMOL/pQdvcHyMWJtHD/L5zERMPC9E6D ys6g== X-Gm-Message-State: ALoCoQm2baYRokdH4EyXyZI9MNqw12qVr+n7SBBF+C6r0OLFXLiogqRQG0G+hizwdo/0Uvi2nARr MIME-Version: 1.0 X-Received: by 10.58.215.15 with SMTP id oe15mr1688305vec.25.1377787972595; Thu, 29 Aug 2013 07:52:52 -0700 (PDT) Received: by 10.52.248.203 with HTTP; Thu, 29 Aug 2013 07:52:52 -0700 (PDT) Date: Thu, 29 Aug 2013 16:52:52 +0200 Message-ID: Subject: [yarn] job is not getting assigned From: Andre Kelpe To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=089e01177235aec8ac04e5174213 X-Virus-Checked: Checked by ClamAV on apache.org --089e01177235aec8ac04e5174213 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hi, I am in the middle of setting up a hadoop 2 cluster. I am using the hadoop 2.1-beta tarball. My cluster has 1 master node running the hdfs namenode, the resourcemanger and the job history server. Next to that I have 3 nodes acting as datanodes and nodemanagers. In order to test, if everything is working, I submitted the teragen job from the hadoop-examples jar like this: $ hadoop jar $HADOOP_PREFIX/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.1.0-beta.= jar teragen 1000 /user/vagrant/teragen The job starts up and I get the following output: 13/08/29 14:42:46 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 13/08/29 14:42:47 INFO client.RMProxy: Connecting to ResourceManager at master.local/192.168.7.10:8032 13/08/29 14:42:48 INFO terasort.TeraSort: Generating 1000 using 2 13/08/29 14:42:48 INFO mapreduce.JobSubmitter: number of splits:2 13/08/29 14:42:48 WARN conf.Configuration: user.name is deprecated. Instead, use mapreduce.job.user.name 13/08/29 14:42:48 WARN conf.Configuration: mapred.jar is deprecated. Instead, use mapreduce.job.jar 13/08/29 14:42:48 WARN conf.Configuration: mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces 13/08/29 14:42:48 WARN conf.Configuration: mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class 13/08/29 14:42:48 WARN conf.Configuration: mapreduce.map.class is deprecated. Instead, use mapreduce.job.map.class 13/08/29 14:42:48 WARN conf.Configuration: mapred.job.name is deprecated. Instead, use mapreduce.job.name 13/08/29 14:42:48 WARN conf.Configuration: mapreduce.inputformat.class is deprecated. Instead, use mapreduce.job.inputformat.class 13/08/29 14:42:48 WARN conf.Configuration: mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir 13/08/29 14:42:48 WARN conf.Configuration: mapreduce.outputformat.class is deprecated. Instead, use mapreduce.job.outputformat.class 13/08/29 14:42:48 WARN conf.Configuration: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps 13/08/29 14:42:48 WARN conf.Configuration: mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class 13/08/29 14:42:48 WARN conf.Configuration: mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir 13/08/29 14:42:49 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1377787324271_0001 13/08/29 14:42:50 INFO impl.YarnClientImpl: Submitted application application_1377787324271_0001 to ResourceManager at master.local/ 192.168.7.10:8032 13/08/29 14:42:50 INFO mapreduce.Job: The url to track the job: http://master.local:8088/proxy/application_1377787324271_0001/ 13/08/29 14:42:50 INFO mapreduce.Job: Running job: job_1377787324271_0001 and then it stops. If I check the UI, I see this: application_1377787324271_0001 vagrantTeraGenMAPREDUCEdefaultThu, 29 Aug 2013 14:42:49 GMTN/AACCEPTED UNDEFINED UNASSIGNED I have no idea, why it is not starting, nor what to look for. Any pointers are more than welcome! Thanks! - Andr=E9 --=20 Andr=E9 Kelpe andre@concurrentinc.com http://concurrentinc.com --089e01177235aec8ac04e5174213 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hi,

I am in the= middle of setting up a hadoop 2 cluster. I am using the hadoop 2.1-beta ta= rball.

My cluster has 1 master node running the hdfs namenode= , the resourcemanger and the job history server. Next to that I have=A0 3 n= odes acting as datanodes and nodemanagers.

In order to test, if everything is working, I submitted the terag= en job from the hadoop-examples jar like this:

$ hadoop jar $HADOOP_= PREFIX/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.1.0-beta.jar tera= gen 1000 /user/vagrant/teragen

The job starts up and I=A0 get the following output:

13/08= /29 14:42:46 WARN util.NativeCodeLoader: Unable to load native-hadoop libra= ry for your platform... using builtin-java classes where applicable
13/0= 8/29 14:42:47 INFO client.RMProxy: Connecting to ResourceManager at master.= local/192.168.7.10:8032
13/08/29 14:42:48 INFO terasort.TeraSort: Generating 1000 using 2
13/08/= 29 14:42:48 INFO mapreduce.JobSubmitter: number of splits:2
13/08/29 14:= 42:48 WARN conf.Configuration: user.name i= s deprecated. Instead, use mapre= duce.job.user.name
13/08/29 14:42:48 WARN conf.Configuration: mapred.jar is deprecated. Instea= d, use mapreduce.job.jar
13/08/29 14:42:48 WARN conf.Configuration: mapr= ed.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
13/08/= 29 14:42:48 WARN conf.Configuration: mapred.output.value.class is deprecate= d. Instead, use mapreduce.job.output.value.class
13/08/29 14:42:48 WARN conf.Configuration: mapreduce.map.class is deprecate= d. Instead, use mapreduce.job.map.class
13/08/29 14:42:48 WARN conf.Conf= iguration: mapred.job.name is deprec= ated. Instead, use mapreduce.job.name=
13/08/29 14:42:48 WARN conf.Configuration: mapreduce.inputformat.class is d= eprecated. Instead, use mapreduce.job.inputformat.class
13/08/29 14:42:4= 8 WARN conf.Configuration: mapred.output.dir is deprecated. Instead, use ma= preduce.output.fileoutputformat.outputdir
13/08/29 14:42:48 WARN conf.Configuration: mapreduce.outputformat.class is = deprecated. Instead, use mapreduce.job.outputformat.class
13/08/29 14:42= :48 WARN conf.Configuration: mapred.map.tasks is deprecated. Instead, use m= apreduce.job.maps
13/08/29 14:42:48 WARN conf.Configuration: mapred.output.key.class is depre= cated. Instead, use mapreduce.job.output.key.class
13/08/29 14:42:48 WAR= N conf.Configuration: mapred.working.dir is deprecated. Instead, use mapred= uce.job.working.dir
13/08/29 14:42:49 INFO mapreduce.JobSubmitter: Submitting tokens for job: j= ob_1377787324271_0001
13/08/29 14:42:50 INFO impl.YarnClientImpl: Submit= ted application application_1377787324271_0001 to ResourceManager at master= .local/192.168.7.10:8032
13/08/29 14:42:50 INFO mapreduce.Job: The url to track the job: http://mast= er.local:8088/proxy/application_1377787324271_0001/
13/08/29 14:42:5= 0 INFO mapreduce.Job: Running job: job_1377787324271_0001

and then it stops. If I check the UI, I see this:

application= _1377787324271_0001 vagrantTeraGenMAPRED= UCEdefaultThu, 29 Aug 2013 14:42:49= GMTN/AACCEPTED= UNDEFINED

UNASSIGNED

I h= ave no idea, why it is not starting, nor what to look for. Any pointers are= more than welcome!

Thanks!
<= div>
- Andr=E9
--089e01177235aec8ac04e5174213--