Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 17DB9952D for ; Sat, 17 Mar 2012 20:54:00 +0000 (UTC) Received: (qmail 84870 invoked by uid 500); 17 Mar 2012 20:53:56 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 84801 invoked by uid 500); 17 Mar 2012 20:53:56 -0000 Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-user@hadoop.apache.org Delivered-To: mailing list common-user@hadoop.apache.org Received: (qmail 84793 invoked by uid 99); 17 Mar 2012 20:53:56 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 17 Mar 2012 20:53:56 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of harsh@cloudera.com designates 209.85.216.176 as permitted sender) Received: from [209.85.216.176] (HELO mail-qc0-f176.google.com) (209.85.216.176) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 17 Mar 2012 20:53:51 +0000 Received: by qcsd1 with SMTP id d1so700719qcs.35 for ; Sat, 17 Mar 2012 13:53:30 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type:content-transfer-encoding:x-gm-message-state; bh=p+BkVqcjg1JpB/bi0PPD4zgz+0jXXS941/5KLAw7eFs=; b=EUl2oXBHAFg/OOhNRA/MsDe9RIw6MvGvoWOFTHqSHD+O9WSq5nl+V0563lplI5ksO+ QmYFpmk2obL6nmN/B58FR/PUbxaI2GTNVuQ5/WVs5Fgxazb9KQk6RiZfA6dSEyc9xKiB bVqFqNIi8BsS8r6aAsjx6n7DR2Zgl0xQAkSSV5oNRDmEOWgjotlSsuC2RG3025DDzbc5 qWhZ+Dlixr8pZDtYmUi3r1MHP3tjq47DKgjUuz9zfHMxo0iZflsWdqdRhaM5nxD41K8l N3qwZJpJZgrh6z1JbL8sG/wFTHAUtyr21L4sjZR1bsQiMNXmqhCiyOhTGBTgPYZk2vlD Ikkw== Received: by 10.229.78.165 with SMTP id l37mr2652688qck.142.1332017610619; Sat, 17 Mar 2012 13:53:30 -0700 (PDT) MIME-Version: 1.0 Received: by 10.229.201.104 with HTTP; Sat, 17 Mar 2012 13:53:10 -0700 (PDT) In-Reply-To: References: From: Harsh J Date: Sun, 18 Mar 2012 02:23:10 +0530 Message-ID: Subject: Re: YARN applications not running To: common-user@hadoop.apache.org, pnaudus@dataraker.com Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Gm-Message-State: ALoCoQln2Yg9VRAX7F5ow1bPM/K6TwfVAa3L1TGy9toVDEknwrSB5xjR9rwWJQ86X3B7xBbn4z4m X-Virus-Checked: Checked by ClamAV on apache.org Hey Peter, The following log: 2012-03-15 19:36:16,645 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Registered with ResourceManager as torb1pnb002.dataraker.net:35665 with total resource of memory: 1000 Indicates the issue. Your NM has only 1000mb to serve as resources, cause of your yarn.nodemanager.resource.memory-mb configuration. Your job, however, with AM + Task Containers demand > 1000 (1024 by default, see MAPREDUCE-4026). Hence the resource requests can't be granted by this NM, and the RM can't find another NM that may accept such high requests. Quick fix is to simply raise yarn.nodemanager.resource.memory-mb back to its default of 8192 (8 GB) or higher. On Fri, Mar 16, 2012 at 1:22 AM, Peter Naudus wrote= : > Hello all, > > When submitting an Hbase export job to YARN, I see it appearing on the we= b > UI but for some reason, the job never starts; it constantly stays at 0% > complete. I am using hadoop 0.23 and hbase 0.92 ( CDH4 beta 1 ) > > I see the NodeManagers connecting to the ResourceManager: > > 2012-03-15 19:36:10,585 INFO > org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeImpl: > torb1pnb001.dataraker.net:46696 Node Transitioned from NEW to RUNNING > 2012-03-15 19:36:16,633 INFO org.apache.hadoop.yarn.util.RackResolver: > Resolved torb1pnb002.dataraker.net to /default-rack > 2012-03-15 19:36:16,633 INFO > org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService: > NodeManager from node torb1pnb002.dataraker.net(cmPort: 35665 httpPort: > 9999) registered with capability: 1000, assigned nodeId > torb1pnb002.dataraker.net:35665 > 2012-03-15 19:36:16,634 INFO > org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeImpl: > torb1pnb002.dataraker.net:35665 Node Transitioned from NEW to RUNNING > [ etc... ] > > and the job being submitted to the ResourceManager: > > 2012-03-15 19:40:29,248 INFO > org.apache.hadoop.yarn.server.resourcemanager.ClientRMService: Allocated = new > applicationId: 1 > 2012-03-15 19:40:31,323 INFO > org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: > application_1331840162147_0001 State change from NEW to SUBMITTED > 2012-03-15 19:40:31,323 INFO > org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: > Registering appattempt_1331840162147_0001_000001 > 2012-03-15 19:40:31,323 INFO > org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptI= mpl: > appattempt_1331840162147_0001_000001 State change from NEW to SUBMITTED > 2012-03-15 19:40:31,327 INFO > org.apache.hadoop.yarn.server.resourcemanager.ClientRMService: Applicatio= n > with id 1 submitted by user hdfs with application_id [..snip..] > 2012-03-15 19:40:31,329 INFO > org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=3Dhdfs > IP=3D10.192.16.64 OPERATION=3DSubmit Application Request > =A0TARGET=3DClientRMService =A0RESULT=3DSUCCESS > =A0APPID=3Dapplication_1331840162147_0001 > 2012-03-15 19:40:31,333 INFO > org.apache.hadoop.yarn.server.resourcemanager.scheduler.fifo.FifoSchedule= r: > Application Submission: application_1331840162147_0001 from hdfs, current= ly > active: 1 > 2012-03-15 19:40:31,336 INFO > org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptI= mpl: > appattempt_1331840162147_0001_000001 State change from SUBMITTED to > SCHEDULED > 2012-03-15 19:40:31,336 INFO > org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: > application_1331840162147_0001 State change from SUBMITTED to ACCEPTED > > but after the NodeManager starts, the log never indicates any requests fr= om > the ResourceManager > > 2012-03-15 19:36:16,604 INFO > org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Connecte= d > to ResourceManager at torb1pna001:8025 > 2012-03-15 19:36:16,645 INFO > org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Register= ed > with ResourceManager as torb1pnb002.dataraker.net:35665 with total resour= ce > of memory: 1000 > 2012-03-15 19:36:16,645 INFO org.apache.hadoop.yarn.service.AbstractServi= ce: > Service:org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl i= s > started. > 2012-03-15 19:36:16,646 INFO org.apache.hadoop.yarn.service.AbstractServi= ce: > Service:org.apache.hadoop.yarn.server.nodemanager.NodeManager is started. > [ end of log ] > > I am seeing strange errors in Zookeeper when the job is submitted: > > 2012-03-15 16:58:00,216 - INFO > =A0[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@213] - > Accepted socket connection from /127.0.0.1:33262 > 2012-03-15 16:58:00,219 - INFO > =A0[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:ZooKeeperServer@838] - Clie= nt > attempting to establish new session at /127.0.0.1:33262 > 2012-03-15 16:58:00,229 - INFO =A0[CommitProcessor:0:ZooKeeperServer@604]= - > Established session 0x35d53d539f0071 with negotiated timeout 40000 for > client /127.0.0.1:33262 > 2012-03-15 16:58:48,884 - WARN > =A0[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@349] - caught= end > of stream exception > EndOfStreamException: Unable to read additional data from client sessioni= d > 0x35d53d539f0071, likely client has closed socket > =A0 =A0 =A0 =A0at > org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220) > =A0 =A0 =A0 =A0at > org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory= .java:224) > =A0 =A0 =A0 =A0at java.lang.Thread.run(Thread.java:662) > 2012-03-15 16:58:48,885 - INFO > =A0[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@1000] - Close= d > socket connection for client /127.0.0.1:33262 which had sessionid > 0x35d53d539f0071 > 2012-03-15 17:02:59,968 - INFO > =A0[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@213] - > Accepted socket connection from /127.0.0.1:59652 > 2012-03-15 17:02:59,971 - INFO > =A0[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:ZooKeeperServer@838] - Clie= nt > attempting to establish new session at /127.0.0.1:59652 > 2012-03-15 17:02:59,978 - INFO =A0[CommitProcessor:0:ZooKeeperServer@604]= - > Established session 0x35d53d539f0072 with negotiated timeout 40000 for > client /127.0.0.1:59652 > 2012-03-15 17:18:39,480 - WARN > =A0[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@349] - caught= end > of stream exception > EndOfStreamException: Unable to read additional data from client sessioni= d > 0x35d53d539f0072, likely client has closed socket > =A0 =A0 =A0 =A0at > org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220) > =A0 =A0 =A0 =A0at > org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory= .java:224) > =A0 =A0 =A0 =A0at java.lang.Thread.run(Thread.java:662) > 2012-03-15 17:18:39,481 - INFO > =A0[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@1000] - Close= d > socket connection for client /127.0.0.1:59652 which had sessionid > 0x35d53d539f0072 > 2012-03-15 17:48:32,406 - INFO > =A0[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@213] - > Accepted socket connection from /127.0.0.1:40908 > 2012-03-15 17:48:32,409 - INFO > =A0[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:ZooKeeperServer@838] - Clie= nt > attempting to establish new session at /127.0.0.1:40908 > 2012-03-15 17:48:32,420 - INFO =A0[CommitProcessor:0:ZooKeeperServer@604]= - > Established session 0x35d53d539f0073 with negotiated timeout 40000 for > client /127.0.0.1:40908 > 2012-03-15 18:40:19,836 - WARN > =A0[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@349] - caught= end > of stream exception > EndOfStreamException: Unable to read additional data from client sessioni= d > 0x35d53d539f0073, likely client has closed socket > =A0 =A0 =A0 =A0at > org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220) > =A0 =A0 =A0 =A0at > org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory= .java:224) > =A0 =A0 =A0 =A0at java.lang.Thread.run(Thread.java:662) > 2012-03-15 18:40:19,837 - INFO > =A0[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@1000] - Close= d > socket connection for client /127.0.0.1:40908 which had sessionid > 0x35d53d539f0073 > 2012-03-15 19:40:30,503 - INFO > =A0[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@213] - > Accepted socket connection from /127.0.0.1:45743 > 2012-03-15 19:40:30,506 - INFO > =A0[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:ZooKeeperServer@838] - Clie= nt > attempting to establish new session at /127.0.0.1:45743 > 2012-03-15 19:40:30,518 - INFO =A0[CommitProcessor:0:ZooKeeperServer@604]= - > Established session 0x35d53d539f0074 with negotiated timeout 40000 for > client /127.0.0.1:45743 > > Any ideas how to debug this? > > [--- yarn-site.xml ---] > > > > > =A0 =A0 > =A0 =A0 =A0 =A0yarn.nodemanager.local-dirs > =A0 =A0 =A0 =A0/tmp/nm-local-dir > =A0 =A0 =A0 =A0List of directories to store localized files > in. > =A0 =A0 > > =A0 =A0 > =A0 =A0 =A0 =A0yarn.nodemanager.log-dirs > =A0 =A0 =A0 =A0/tmp/logs > =A0 =A0 =A0 =A0Where to store container logs. > =A0 =A0 > > =A0 =A0 > =A0 =A0 =A0 =A0yarn.nodemanager.resource.memory-mb > =A0 =A0 =A0 =A01000 > =A0 =A0 =A0 =A0Amount of physical memory, in MB, that can be= allocated > for containers. > =A0 =A0 > > =A0 =A0 > =A0 =A0 =A0 =A0yarn.resourcemanager.address > =A0 =A0 =A0 =A0torb1pna001:8040 > =A0 =A0 =A0 =A0The address of the applications manager inter= face in the > RM. > =A0 =A0 > > =A0 =A0 > =A0 =A0 =A0 =A0yarn.resourcemanager.scheduler.address > =A0 =A0 =A0 =A0torb1pna001:8030 > =A0 =A0 =A0 =A0The address of the scheduler interface. > =A0 =A0 > > =A0 =A0 > =A0 =A0 =A0 =A0yarn.resourcemanager.webapp.address > =A0 =A0 =A0 =A0torb1pna001:8088 > =A0 =A0 =A0 =A0The address of the RM web application. > =A0 =A0 > > =A0 =A0 > =A0 =A0 =A0 =A0yarn.resourcemanager.resource-tracker.address > =A0 =A0 =A0 =A0torb1pna001:8025 > =A0 =A0 =A0 =A0 > =A0 =A0 > > =A0 =A0 > =A0 =A0 =A0 =A0yarn.resourcemanager.admin.address > =A0 =A0 =A0 =A0torb1pna001:8141 > =A0 =A0 =A0 =A0The address of the RM admin interface. > =A0 =A0 > > =A0 =A0 > =A0 =A0 =A0 =A0yarn.nodemanager.aux-services > =A0 =A0 =A0 =A0mapreduce.shuffle > =A0 =A0 > > =A0 =A0 > =A0 =A0 =A0 =A0yarn.nodemanager.aux-services.mapreduce.shuffle.clas= s > =A0 =A0 =A0 =A0org.apache.hadoop.mapred.ShuffleHandler > =A0 =A0 > > > > [--- mapred-site.xml ---] > > > > > > > > > =A0 > =A0 =A0 =A0 =A0mapreduce.framework.name > =A0 =A0 =A0 =A0yarn > =A0 > > > =A0 > =A0 =A0 =A0 =A0mapreduce.jobhistory.address > =A0 =A0 =A0 =A0torb1pna001:10020 > =A0 > > =A0 > =A0 =A0 =A0 =A0mapreduce.jobhistory.webapp.address > =A0 =A0 =A0 =A0torb1pna001:19888 > =A0 > > > =A0 > =A0 =A0 =A0 =A0mapreduce.jobhistory.intermediate-done-dir > =A0 =A0 =A0 =A0/tmp/mr-history/tmp > =A0 > > =A0 > =A0 =A0 =A0 =A0mapreduce.jobhistory.done-dir > =A0 =A0 =A0 =A0/tmp/mr-history/done > =A0 > > > > [--- output from HBase export ---] > > bash-3.2$ hadoop jar hbase-0.92.0-cdh4b1.jar export dev /backups/dev > 12/03/15 17:48:30 INFO mapreduce.Export: verisons=3D1, starttime=3D0, > endtime=3D9223372036854775807 > 12/03/15 17:48:30 WARN conf.Configuration: mapred.used.genericoptionspars= er > is deprecated. Instead, use mapreduce.client.genericoptionsparser.used > 12/03/15 17:48:30 WARN conf.Configuration: io.bytes.per.checksum is > deprecated. Instead, use dfs.bytes-per-checksum > 12/03/15 17:48:32 INFO zookeeper.ZooKeeper: Client > environment:zookeeper.version=3D3.4.2-1221870, built on 12/21/2011 20:46 = GMT > 12/03/15 17:48:32 INFO zookeeper.ZooKeeper: Client > environment:host.name=3Dtorb1pna001.dataraker.net > 12/03/15 17:48:32 INFO zookeeper.ZooKeeper: Client > environment:java.version=3D1.6.0_27 > 12/03/15 17:48:32 INFO zookeeper.ZooKeeper: Client > environment:java.vendor=3DSun Microsystems Inc. > 12/03/15 17:48:32 INFO zookeeper.ZooKeeper: Client > environment:java.home=3D/usr/java/jdk1.6.0_27/jre > 12/03/15 17:48:32 INFO zookeeper.ZooKeeper: Client > environment:java.class.path=3D/etc/hadoop/conf:/usr/<...snip...> > 12/03/15 17:48:32 INFO zookeeper.ZooKeeper: Client > environment:java.library.path=3D/usr/lib/hadoop/lib/native > 12/03/15 17:48:32 INFO zookeeper.ZooKeeper: Client > environment:java.io.tmpdir=3D/tmp > 12/03/15 17:48:32 INFO zookeeper.ZooKeeper: Client > environment:java.compiler=3D > 12/03/15 17:48:32 INFO zookeeper.ZooKeeper: Client environment:os.name=3D= Linux > 12/03/15 17:48:32 INFO zookeeper.ZooKeeper: Client environment:os.arch=3D= amd64 > 12/03/15 17:48:32 INFO zookeeper.ZooKeeper: Client > environment:os.version=3D2.6.18-274.el5 > 12/03/15 17:48:32 INFO zookeeper.ZooKeeper: Client > environment:user.name=3Dhdfs > 12/03/15 17:48:32 INFO zookeeper.ZooKeeper: Client > environment:user.home=3D/home/hadoop > 12/03/15 17:48:32 INFO zookeeper.ZooKeeper: Client > environment:user.dir=3D/usr/lib/hbase > 12/03/15 17:48:32 INFO zookeeper.ZooKeeper: Initiating client connection, > connectString=3Dlocalhost:2181 sessionTimeout=3D180000 watcher=3Dhconnect= ion > 12/03/15 17:48:32 INFO zookeeper.ClientCnxn: Opening socket connection to > server /127.0.0.1:2181 > 12/03/15 17:48:32 INFO zookeeper.ClientCnxn: Socket connection establishe= d > to localhost.localdomain/127.0.0.1:2181, initiating session > 12/03/15 17:48:32 INFO zookeeper.RecoverableZooKeeper: The identifier of > this process is 18411@torb1pna001.dataraker.net > 12/03/15 17:48:32 INFO zookeeper.ClientCnxn: Session establishment comple= te > on server localhost.localdomain/127.0.0.1:2181, sessionid =3D > 0x35d53d539f0073, negotiated timeout =3D 40000 > 12/03/15 17:48:32 WARN conf.Configuration: hadoop.native.lib is deprecate= d. > Instead, use io.native.lib.available > 12/03/15 17:48:32 WARN conf.Configuration: hadoop.native.lib is deprecate= d. > Instead, use io.native.lib.available > 12/03/15 17:48:32 WARN conf.Configuration: hadoop.native.lib is deprecate= d. > Instead, use io.native.lib.available > 12/03/15 17:48:32 WARN conf.Configuration: hadoop.native.lib is deprecate= d. > Instead, use io.native.lib.available > 12/03/15 17:48:32 INFO mapreduce.JobSubmitter: number of splits:73 > 12/03/15 17:48:32 WARN conf.Configuration: io.bytes.per.checksum is > deprecated. Instead, use dfs.bytes-per-checksum > 12/03/15 17:48:33 INFO mapred.ResourceMgrDelegate: Submitted application > application_1331830579833_0004 to ResourceManager at > torb1pna001/10.192.16.64:8040 > 12/03/15 17:48:33 INFO mapreduce.Job: The url to track the job: > http://torb1pna001:8088/proxy/application_1331830579833_0004/ > 12/03/15 17:48:33 INFO mapreduce.Job: Running job: job_1331830579833_0004 > bash-3.2$ hadoop jar hbase-0.92.0-cdh4b1.jar export bch_dev /backups/bch_= dev > WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please > use org.apache.hadoop.log.metrics.EventCounter in all the log4j.propertie= s > files. > 12/03/15 19:40:28 INFO mapreduce.Export: verisons=3D1, starttime=3D0, > endtime=3D9223372036854775807 > 12/03/15 19:40:28 WARN conf.Configuration: mapred.used.genericoptionspars= er > is deprecated. Instead, use mapreduce.client.genericoptionsparser.used > 12/03/15 19:40:28 WARN conf.Configuration: io.bytes.per.checksum is > deprecated. Instead, use dfs.bytes-per-checksum > 12/03/15 19:40:30 INFO zookeeper.ZooKeeper: Client > environment:zookeeper.version=3D3.4.2-1221870, built on 12/21/2011 20:46 = GMT > 12/03/15 19:40:30 INFO zookeeper.ZooKeeper: Client > environment:host.name=3Dtorb1pna001.dataraker.net > 12/03/15 19:40:30 INFO zookeeper.ZooKeeper: Client > environment:java.version=3D1.6.0_27 > 12/03/15 19:40:30 INFO zookeeper.ZooKeeper: Client > environment:java.vendor=3DSun Microsystems Inc. > 12/03/15 19:40:30 INFO zookeeper.ZooKeeper: Client > environment:java.home=3D/usr/java/jdk1.6.0_27/jre > 12/03/15 19:40:30 INFO zookeeper.ZooKeeper: Client > environment:java.class.path=3D/etc/hadoop/conf:<...snip...> > 12/03/15 19:40:30 INFO zookeeper.ZooKeeper: Client > environment:java.library.path=3D/usr/lib/hadoop/lib/native > 12/03/15 19:40:30 INFO zookeeper.ZooKeeper: Client > environment:java.io.tmpdir=3D/tmp > 12/03/15 19:40:30 INFO zookeeper.ZooKeeper: Client > environment:java.compiler=3D > 12/03/15 19:40:30 INFO zookeeper.ZooKeeper: Client environment:os.name=3D= Linux > 12/03/15 19:40:30 INFO zookeeper.ZooKeeper: Client environment:os.arch=3D= amd64 > 12/03/15 19:40:30 INFO zookeeper.ZooKeeper: Client > environment:os.version=3D2.6.18-274.el5 > 12/03/15 19:40:30 INFO zookeeper.ZooKeeper: Client > environment:user.name=3Dhdfs > 12/03/15 19:40:30 INFO zookeeper.ZooKeeper: Client > environment:user.home=3D/home/hadoop > 12/03/15 19:40:30 INFO zookeeper.ZooKeeper: Client > environment:user.dir=3D/usr/lib/hbase > 12/03/15 19:40:30 INFO zookeeper.ZooKeeper: Initiating client connection, > connectString=3Dlocalhost:2181 sessionTimeout=3D180000 watcher=3Dhconnect= ion > 12/03/15 19:40:30 INFO zookeeper.ClientCnxn: Opening socket connection to > server /127.0.0.1:2181 > 12/03/15 19:40:30 INFO zookeeper.ClientCnxn: Socket connection establishe= d > to localhost.localdomain/127.0.0.1:2181, initiating session > 12/03/15 19:40:30 INFO zookeeper.RecoverableZooKeeper: The identifier of > this process is 19732@torb1pna001.dataraker.net > 12/03/15 19:40:30 INFO zookeeper.ClientCnxn: Session establishment comple= te > on server localhost.localdomain/127.0.0.1:2181, sessionid =3D > 0x35d53d539f0074, negotiated timeout =3D 40000 > 12/03/15 19:40:30 WARN conf.Configuration: hadoop.native.lib is deprecate= d. > Instead, use io.native.lib.available > 12/03/15 19:40:30 WARN conf.Configuration: hadoop.native.lib is deprecate= d. > Instead, use io.native.lib.available > 12/03/15 19:40:30 WARN conf.Configuration: hadoop.native.lib is deprecate= d. > Instead, use io.native.lib.available > 12/03/15 19:40:30 WARN conf.Configuration: hadoop.native.lib is deprecate= d. > Instead, use io.native.lib.available > 12/03/15 19:40:30 INFO mapreduce.JobSubmitter: number of splits:73 > 12/03/15 19:40:30 WARN conf.Configuration: io.bytes.per.checksum is > deprecated. Instead, use dfs.bytes-per-checksum > 12/03/15 19:40:31 INFO mapred.ResourceMgrDelegate: Submitted application > application_1331840162147_0001 to ResourceManager at > torb1pna001/10.192.16.64:8040 > 12/03/15 19:40:31 INFO mapreduce.Job: The url to track the job: > http://torb1pna001:8088/proxy/application_1331840162147_0001/ > 12/03/15 19:40:31 INFO mapreduce.Job: Running job: job_1331840162147_0001 --=20 Harsh J