giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Roman Shaposhnik <ro...@shaposhnik.org>
Subject Re: Issue Running Giraph Job
Date Wed, 30 Oct 2013 21:54:38 GMT
Do you have a dedicated Zookeeper ensemble running on your cluster?
It feels like something is conflicting on ports with an embedded one.

Thanks,
Roman.

On Wed, Oct 30, 2013 at 12:48 PM, Artie Pesh-Imam
<artie.pesh-imam@tapad.com> wrote:
> Hi all,
>
> I'm able to run this job locally but when I try to run against our cluster,
> the job seems to fail. Here's the log entries.
>
> It looks like it's not proceeding beyond superstep 0. Is there anyway to get
> a more detailed picture of what's going on?
>
> 2013-10-30 19:38:04,467 WARN mapreduce.Counters: Group
> org.apache.hadoop.mapred.Task$Counter is deprecated. Use
> org.apache.hadoop.mapreduce.TaskCounter instead 2013-10-30 19:38:05,157 WARN
> org.apache.hadoop.conf.Configuration: session.id is deprecated. Instead, use
> dfs.metrics.session-id 2013-10-30 19:38:05,158 INFO
> org.apache.hadoop.metrics.jvm.JvmMetrics: Initializing JVM Metrics with
> processName=MAP, sessionId= 2013-10-30 19:38:05,634 INFO
> org.apache.hadoop.util.ProcessTree: setsid exited with exit code 0
> 2013-10-30 19:38:05,639 INFO org.apache.hadoop.mapred.Task: Using
> ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@371e88fb 2013-10-30
> 19:38:06,029 INFO org.apache.hadoop.mapred.MapTask: Processing split:
> 'org.apache.giraph.bsp.BspInputSplit, index=-1, num=-1 2013-10-30
> 19:38:06,047 INFO org.apache.giraph.graph.GraphTaskManager: setup: Log level
> remains at info 2013-10-30 19:38:06,117 INFO
> org.apache.giraph.graph.GraphTaskManager: Distributed cache is empty.
> Assuming fatjar. 2013-10-30 19:38:06,117 INFO
> org.apache.giraph.graph.GraphTaskManager: setup: classpath @
> /d02/dfs/dn/tasktracker/taskTracker/artie.pesh-imam/jobcache/job_201310301559_0024/jars/job.jar
> for job jobs.ConnectedComponents 2013-10-30 19:38:06,155 INFO
> org.apache.giraph.zk.ZooKeeperManager: createCandidateStamp: Made the
> directory _bsp/_defaultZkManagerDir/job_201310301559_0024 2013-10-30
> 19:38:06,166 INFO org.apache.giraph.zk.ZooKeeperManager:
> createCandidateStamp: Creating my filestamp
> _bsp/_defaultZkManagerDir/job_201310301559_0024/_task/datanode05.prd.nj1.tapad.com
> 0 2013-10-30 19:38:06,216 INFO org.apache.giraph.zk.ZooKeeperManager:
> getZooKeeperServerList: Got [datanode05.prd.nj1.tapad.com] 1 hosts from 1
> candidates when 1 required (polling period is 3000) on attempt 0 2013-10-30
> 19:38:06,217 INFO org.apache.giraph.zk.ZooKeeperManager:
> createZooKeeperServerList: Creating the final ZooKeeper file
> '_bsp/_defaultZkManagerDir/job_201310301559_0024/zkServerList_datanode05.prd.nj1.tapad.com
> 0 ' 2013-10-30 19:38:06,235 INFO org.apache.giraph.zk.ZooKeeperManager:
> getZooKeeperServerList: For task 0, got file
> 'zkServerList_datanode05.prd.nj1.tapad.com 0 ' (polling period is 3000)
> 2013-10-30 19:38:06,235 INFO org.apache.giraph.zk.ZooKeeperManager:
> getZooKeeperServerList: Found [datanode05.prd.nj1.tapad.com, 0] 2 hosts in
> filename 'zkServerList_datanode05.prd.nj1.tapad.com 0 ' 2013-10-30
> 19:38:06,236 INFO org.apache.giraph.zk.ZooKeeperManager:
> onlineZooKeeperServers: Trying to delete old directory
> /d06/dfs/dn/tasktracker/taskTracker/artie.pesh-imam/jobcache/job_201310301559_0024/work/_bspZooKeeper
> 2013-10-30 19:38:06,243 INFO org.apache.giraph.zk.ZooKeeperManager:
> generateZooKeeperConfigFile: Creating file
> /d06/dfs/dn/tasktracker/taskTracker/artie.pesh-imam/jobcache/job_201310301559_0024/work/_bspZooKeeper/zoo.cfg
> in
> /d06/dfs/dn/tasktracker/taskTracker/artie.pesh-imam/jobcache/job_201310301559_0024/work/_bspZooKeeper
> with base port 22181 2013-10-30 19:38:06,243 INFO
> org.apache.giraph.zk.ZooKeeperManager: generateZooKeeperConfigFile: Make
> directory of _bspZooKeeper = true 2013-10-30 19:38:06,243 INFO
> org.apache.giraph.zk.ZooKeeperManager: generateZooKeeperConfigFile: Delete
> of zoo.cfg = false 2013-10-30 19:38:06,246 INFO
> org.apache.giraph.zk.ZooKeeperManager: onlineZooKeeperServers: Attempting to
> start ZooKeeper server with command [/usr/java/jdk1.7.0_40/jre/bin/java,
> -Xmx512m, -XX:ParallelGCThreads=4, -XX:+UseConcMarkSweepGC,
> -XX:CMSInitiatingOccupancyFraction=70, -XX:MaxGCPauseMillis=100, -cp,
> /d02/dfs/dn/tasktracker/taskTracker/artie.pesh-imam/jobcache/job_201310301559_0024/jars/job.jar,
> org.apache.zookeeper.server.quorum.QuorumPeerMain,
> /d06/dfs/dn/tasktracker/taskTracker/artie.pesh-imam/jobcache/job_201310301559_0024/work/_bspZooKeeper/zoo.cfg]
> in directory
> /d06/dfs/dn/tasktracker/taskTracker/artie.pesh-imam/jobcache/job_201310301559_0024/work/_bspZooKeeper
> 2013-10-30 19:38:06,249 INFO org.apache.giraph.zk.ZooKeeperManager:
> onlineZooKeeperServers: Shutdown hook added. 2013-10-30 19:38:06,249 INFO
> org.apache.giraph.zk.ZooKeeperManager: onlineZooKeeperServers: Connect
> attempt 0 of 10 max trying to connect to datanode05.prd.nj1.tapad.com:22181
> with poll msecs = 3000 2013-10-30 19:38:06,253 WARN
> org.apache.giraph.zk.ZooKeeperManager: onlineZooKeeperServers: Got
> ConnectException java.net.ConnectException: Connection refused at
> java.net.PlainSocketImpl.socketConnect(Native Method) at
> java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> at
> java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> at
> java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at
> java.net.Socket.connect(Socket.java:579) at
> org.apache.giraph.zk.ZooKeeperManager.onlineZooKeeperServers(ZooKeeperManager.java:701)
> at
> org.apache.giraph.graph.GraphTaskManager.startZooKeeperManager(GraphTaskManager.java:357)
> at org.apache.giraph.graph.GraphTaskManager.setup(GraphTaskManager.java:188)
> at org.apache.giraph.graph.GraphMapper.setup(GraphMapper.java:60) at
> org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:90) at
> org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:672) at
> org.apache.hadoop.mapred.MapTask.run(MapTask.java:330) at
> org.apache.hadoop.mapred.Child$4.run(Child.java:268) at
> java.security.AccessController.doPrivileged(Native Method) at
> javax.security.auth.Subject.doAs(Subject.java:415) at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
> at org.apache.hadoop.mapred.Child.main(Child.java:262) 2013-10-30
> 19:38:09,256 INFO org.apache.giraph.zk.ZooKeeperManager:
> onlineZooKeeperServers: Connect attempt 1 of 10 max trying to connect to
> datanode05.prd.nj1.tapad.com:22181 with poll msecs = 3000 2013-10-30
> 19:38:09,256 INFO org.apache.giraph.zk.ZooKeeperManager:
> onlineZooKeeperServers: Connected to
> datanode05.prd.nj1.tapad.com/10.20.20.31:22181! 2013-10-30 19:38:09,256 INFO
> org.apache.giraph.zk.ZooKeeperManager: onlineZooKeeperServers: Creating my
> filestamp
> _bsp/_defaultZkManagerDir/job_201310301559_0024/_zkServer/datanode05.prd.nj1.tapad.com
> 0 2013-10-30 19:38:09,291 INFO org.apache.giraph.graph.GraphTaskManager:
> setup: Chosen to run ZooKeeper... 2013-10-30 19:38:09,291 INFO
> org.apache.giraph.graph.GraphTaskManager: setup: Starting up
> BspServiceMaster (master thread)... 2013-10-30 19:38:09,306 INFO
> org.apache.giraph.bsp.BspService: BspService: Connecting to ZooKeeper with
> job job_201310301559_0024, 0 on datanode05.prd.nj1.tapad.com:22181
> 2013-10-30 19:38:09,317 INFO org.apache.zookeeper.ZooKeeper: Client
> environment:zookeeper.version=3.4.5-cdh4.4.0--1, built on 09/03/2013 16:14
> GMT 2013-10-30 19:38:09,317 INFO org.apache.zookeeper.ZooKeeper: Client
> environment:host.name=datanode05.prd.nj1.tapad.com 2013-10-30 19:38:09,317
> INFO org.apache.zookeeper.ZooKeeper: Client
> environment:java.version=1.7.0_40 2013-10-30 19:38:09,317 INFO
> org.apache.zookeeper.ZooKeeper: Client environment:java.vendor=Oracle
> Corporation 2013-10-30 19:38:09,317 INFO org.apache.zookeeper.ZooKeeper:
> Client environment:java.home=/usr/java/jdk1.7.0_40/jre 2013-10-30
> 19:38:09,317 INFO org.apache.zookeeper.ZooKeeper: Client
> environment:java.class.path=/var/run/cloudera-scm-agent/process/238-mapreduce-TASKTRACKER:/usr/java/jdk1.7.0_40/lib/tools.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/hadoop-core-2.0.0-mr1-cdh4.4.0.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/activation-1.1.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/ant-contrib-1.0b3.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/asm-3.2.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/avro-1.7.4.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/avro-compiler-1.7.4.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/commons-beanutils-1.7.0.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/commons-beanutils-core-1.8.0.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/commons-cli-1.2.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/commons-codec-1.4.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/commons-collections-3.2.1.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/commons-compress-1.4.1.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/commons-configuration-1.6.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/commons-digester-1.8.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/commons-el-1.0.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/commons-httpclient-3.1.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/commons-io-2.1.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/commons-lang-2.5.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/commons-logging-1.1.1.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/commons-math-2.1.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/commons-net-3.1.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/guava-11.0.2.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/hadoop-fairscheduler-2.0.0-mr1-cdh4.4.0.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/hsqldb-1.8.0.10.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/jackson-core-asl-1.8.8.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/jackson-jaxrs-1.8.8.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/jackson-xc-1.8.8.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/jasper-compiler-5.5.23.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/jasper-runtime-5.5.23.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/jaxb-api-2.2.2.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/jaxb-impl-2.2.3-1.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/jersey-core-1.8.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/jersey-json-1.8.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/jersey-server-1.8.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/jets3t-0.6.1.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/jettison-1.1.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/jetty-6.1.26.cloudera.2.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/jetty-util-6.1.26.cloudera.2.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/jline-0.9.94.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/jsch-0.1.42.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/jsp-api-2.1.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/jsr305-1.3.9.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/junit-4.8.2.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/kfs-0.2.2.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/kfs-0.3.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/log4j-1.2.17.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/mockito-all-1.8.5.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/paranamer-2.3.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/protobuf-java-2.4.0a.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/servlet-api-2.5.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/slf4j-api-1.6.1.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/snappy-java-1.0.4.1.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/stax-api-1.0.1.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/xmlenc-0.52.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/xz-1.0.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/zookeeper-3.4.5-cdh4.4.0.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/jsp-2.1/jsp-2.1.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/jsp-2.1/jsp-api-2.1.jar:/usr/share/cmf/lib/plugins/tt-instrumentation-4.7.2.jar:/usr/share/cmf/lib/plugins/navigator-plugin-4.7.2-shaded.jar:/usr/share/cmf/lib/plugins/event-publish-4.7.2-shaded.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-hdfs/lib/commons-cli-1.2.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-hdfs/lib/jsp-api-2.1.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-hdfs/lib/jasper-runtime-5.5.23.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-hdfs/lib/jersey-core-1.8.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-hdfs/lib/guava-11.0.2.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-hdfs/lib/log4j-1.2.17.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-hdfs/lib/zookeeper-3.4.5-cdh4.4.0.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-hdfs/lib/servlet-api-2.5.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-hdfs/lib/commons-logging-1.1.1.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-hdfs/lib/asm-3.2.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-hdfs/lib/jetty-util-6.1.26.cloudera.2.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-hdfs/lib/jackson-mapper-asl-1.8.8.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-hdfs/lib/protobuf-java-2.4.0a.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-hdfs/lib/commons-lang-2.5.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-hdfs/lib/jersey-server-1.8.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-hdfs/lib/xmlenc-0.52.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-hdfs/lib/commons-el-1.0.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-hdfs/lib/commons-codec-1.4.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-hdfs/lib/commons-io-2.1.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-hdfs/lib/jetty-6.1.26.cloudera.2.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-hdfs/lib/jline-0.9.94.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-hdfs/lib/jackson-core-asl-1.8.8.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-hdfs/lib/commons-daemon-1.0.3.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-hdfs/lib/jsr305-1.3.9.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-hdfs/hadoop-hdfs-2.0.0-cdh4.4.0.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-hdfs/hadoop-hdfs-2.0.0-cdh4.4.0-tests.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-hdfs/hadoop-hdfs.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/commons-cli-1.2.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/jsp-api-2.1.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/jasper-runtime-5.5.23.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/jackson-xc-1.8.8.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/jettison-1.1.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/jersey-core-1.8.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/guava-11.0.2.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/log4j-1.2.17.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/commons-collections-3.2.1.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/zookeeper-3.4.5-cdh4.4.0.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/servlet-api-2.5.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/commons-beanutils-1.7.0.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/commons-logging-1.1.1.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/asm-3.2.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/jetty-util-6.1.26.cloudera.2.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/jackson-mapper-asl-1.8.8.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/jsch-0.1.42.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/protobuf-java-2.4.0a.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/commons-lang-2.5.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/commons-httpclient-3.1.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/jersey-server-1.8.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/xmlenc-0.52.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/commons-digester-1.8.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/jaxb-api-2.2.2.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/slf4j-log4j12-1.6.1.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/jersey-json-1.8.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/jackson-jaxrs-1.8.8.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/commons-el-1.0.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/commons-compress-1.4.1.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/commons-codec-1.4.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/mockito-all-1.8.5.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/commons-io-2.1.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/slf4j-api-1.6.1.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/jetty-6.1.26.cloudera.2.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/junit-4.8.2.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/paranamer-2.3.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/jline-0.9.94.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/avro-1.7.4.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/activation-1.1.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/snappy-java-1.0.4.1.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/hue-plugins-2.5.0-cdh4.4.0.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/kfs-0.3.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/commons-math-2.1.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/jackson-core-asl-1.8.8.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/commons-beanutils-core-1.8.0.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/commons-net-3.1.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/stax-api-1.0.1.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/jaxb-impl-2.2.3-1.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/xz-1.0.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/commons-configuration-1.6.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/jsr305-1.3.9.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/jasper-compiler-5.5.23.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/lib/jets3t-0.6.1.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/hadoop-common-2.0.0-cdh4.4.0-tests.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/hadoop-annotations-2.0.0-cdh4.4.0.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/hadoop-auth.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/hadoop-auth-2.0.0-cdh4.4.0.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/hadoop-common-2.0.0-cdh4.4.0.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/hadoop-common.jar:/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop/hadoop-annotations.jar:/d02/dfs/dn/tasktracker/taskTracker/artie.pesh-imam/jobcache/job_201310301559_0024/jars/classes:/d02/dfs/dn/tasktracker/taskTracker/artie.pesh-imam/jobcache/job_201310301559_0024/jars/job.jar:/d04/dfs/dn/tasktracker/taskTracker/artie.pesh-imam/jobcache/job_201310301559_0024/attempt_201310301559_0024_m_000000_0/work
> 2013-10-30 19:38:09,317 INFO org.apache.zookeeper.ZooKeeper: Client
> environment:java.library.path=/opt/cloudera/parcels/CDH-4.4.0-1.cdh4.4.0.p0.39/lib/hadoop-0.20-mapreduce/lib/native/Linux-amd64-64:/d04/dfs/dn/tasktracker/taskTracker/artie.pesh-imam/jobcache/job_201310301559_0024/attempt_201310301559_0024_m_000000_0/work
> 2013-10-30 19:38:09,317 INFO org.apache.zookeeper.ZooKeeper: Client
> environment:java.io.tmpdir=/d04/dfs/dn/tasktracker/taskTracker/artie.pesh-imam/jobcache/job_201310301559_0024/attempt_201310301559_0024_m_000000_0/work/tmp
> 2013-10-30 19:38:09,317 INFO org.apache.zookeeper.ZooKeeper: Client
> environment:java.compiler=<NA> 2013-10-30 19:38:09,317 INFO
> org.apache.zookeeper.ZooKeeper: Client environment:os.name=Linux 2013-10-30
> 19:38:09,317 INFO org.apache.zookeeper.ZooKeeper: Client
> environment:os.arch=amd64 2013-10-30 19:38:09,317 INFO
> org.apache.zookeeper.ZooKeeper: Client
> environment:os.version=2.6.32-358.6.2.el6.x86_64 2013-10-30 19:38:09,317
> INFO org.apache.zookeeper.ZooKeeper: Client environment:user.name=mapred
> 2013-10-30 19:38:09,317 INFO org.apache.zookeeper.ZooKeeper: Client
> environment:user.home=/var/lib/hadoop-mapreduce 2013-10-30 19:38:09,317 INFO
> org.apache.zookeeper.ZooKeeper: Client
> environment:user.dir=/d04/dfs/dn/tasktracker/taskTracker/artie.pesh-imam/jobcache/job_201310301559_0024/attempt_201310301559_0024_m_000000_0/work
> 2013-10-30 19:38:09,318 INFO org.apache.zookeeper.ZooKeeper: Initiating
> client connection, connectString=datanode05.prd.nj1.tapad.com:22181
> sessionTimeout=60000
> watcher=org.apache.giraph.master.BspServiceMaster@20d145ec 2013-10-30
> 19:38:09,339 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection
> to server datanode05.prd.nj1.tapad.com/10.20.20.31:22181. Will not attempt
> to authenticate using SASL (unknown error) 2013-10-30 19:38:09,340 INFO
> org.apache.zookeeper.ClientCnxn: Socket connection established to
> datanode05.prd.nj1.tapad.com/10.20.20.31:22181, initiating session
> 2013-10-30 19:38:09,413 WARN org.apache.zookeeper.ClientCnxnSocket:
> Connected to an old server; r-o mode will be unavailable 2013-10-30
> 19:38:09,413 INFO org.apache.zookeeper.ClientCnxn: Session establishment
> complete on server datanode05.prd.nj1.tapad.com/10.20.20.31:22181, sessionid
> = 0x1420adf77390000, negotiated timeout = 600000 2013-10-30 19:38:09,415
> INFO org.apache.giraph.bsp.BspService: process: Asynchronous connection
> complete. 2013-10-30 19:38:09,427 INFO
> org.apache.giraph.graph.GraphTaskManager: map: No need to do anything when
> not a worker 2013-10-30 19:38:09,427 INFO
> org.apache.giraph.graph.GraphTaskManager: cleanup: Starting for
> MASTER_ZOOKEEPER_ONLY 2013-10-30 19:38:09,522 INFO
> org.apache.giraph.master.BspServiceMaster: becomeMaster: First child is
> '/_hadoopBsp/job_201310301559_0024/_masterElectionDir/datanode05.prd.nj1.tapad.com_00000000000'
> and my bid is
> '/_hadoopBsp/job_201310301559_0024/_masterElectionDir/datanode05.prd.nj1.tapad.com_00000000000'
> 2013-10-30 19:38:09,605 INFO org.apache.giraph.comm.netty.NettyServer:
> NettyServer: Using execution handler with 8 threads after
> requestFrameDecoder. 2013-10-30 19:38:09,644 INFO
> org.apache.giraph.comm.netty.NettyServer: start: Started server
> communication server: datanode05.prd.nj1.tapad.com/10.20.20.31:30000 with up
> to 16 threads on bind attempt 0 with sendBufferSize = 32768
> receiveBufferSize = 524288 backlog = 1 2013-10-30 19:38:09,653 INFO
> org.apache.giraph.comm.netty.NettyClient: NettyClient: Using execution
> handler with 8 threads after requestEncoder. 2013-10-30 19:38:09,659 INFO
> org.apache.giraph.master.BspServiceMaster: becomeMaster: I am now the
> master! 2013-10-30 19:38:09,708 INFO org.apache.giraph.bsp.BspService:
> process: applicationAttemptChanged signaled 2013-10-30 19:38:09,773 WARN
> org.apache.giraph.bsp.BspService: process: Unknown and unprocessed event
> (path=/_hadoopBsp/job_201310301559_0024/_applicationAttemptsDir/0/_superstepDir,
> type=NodeChildrenChanged, state=SyncConnected) 2013-10-30 19:38:39,793 INFO
> org.apache.giraph.master.BspServiceMaster: checkWorkers: Only found 0
> responses of -1 needed to start superstep -1. Reporting every 30000 msecs,
> 569875 more msecs left before giving up. 2013-10-30 19:39:09,824 INFO
> org.apache.giraph.master.BspServiceMaster: checkWorkers: Only found 0
> responses of -1 needed to start superstep -1. Reporting every 30000 msecs,
> 539844 more msecs left before giving up. 2013-10-30 19:39:39,846 INFO
> org.apache.giraph.master.BspServiceMaster: checkWorkers: Only found 0
> responses of -1 needed to start superstep -1. Reporting every 30000 msecs,
> 509822 more msecs left before giving up. 2013-10-30 19:40:09,869 INFO
> org.apache.giraph.master.BspServiceMaster: checkWorkers: Only found 0
> responses of -1 needed to start superstep -1. Reporting every 30000 msecs,
> 479799 more msecs left before giving up. 2013-10-30 19:40:39,908 INFO
> org.apache.giraph.master.BspServiceMaster: checkWorkers: Only found 0
> responses of -1 needed to start superstep -1. Reporting every 30000 msecs,
> 449760 more msecs left before giving up. 2013-10-30 19:41:09,931 INFO
> org.apache.giraph.master.BspServiceMaster: checkWorkers: Only found 0
> responses of -1 needed to start superstep -1. Reporting every 30000 msecs,
> 419737 more msecs left before giving up. 2013-10-30 19:41:39,970 INFO
> org.apache.giraph.master.BspServiceMaster: checkWorkers: Only found 0
> responses of -1 needed to start superstep -1. Reporting every 30000 msecs,
> 389698 more msecs left before giving up. 2013-10-30 19:42:10,001 INFO
> org.apache.giraph.master.BspServiceMaster: checkWorkers: Only found 0
> responses of -1 needed to start superstep -1. Reporting every 30000 msecs,
> 359667 more msecs left before giving up. 2013-10-30 19:42:40,040 INFO
> org.apache.giraph.master.BspServiceMaster: checkWorkers: Only found 0
> responses of -1 needed to start superstep -1. Reporting every 30000 msecs,
> 329628 more msecs left before giving up. 2013-10-30 19:43:10,062 INFO
> org.apache.giraph.master.BspServiceMaster: checkWorkers: Only found 0
> responses of -1 needed to start superstep -1. Reporting every 30000 msecs,
> 299606 more msecs left before giving up. 2013-10-30 19:43:40,102 INFO
> org.apache.giraph.master.BspServiceMaster: checkWorkers: Only found 0
> responses of -1 needed to start superstep -1. Reporting every 30000 msecs,
> 269566 more msecs left before giving up.
>
>
>

Mime
View raw message