giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Roman Grebennikov (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GIRAPH-448) orphan process left on DataNode
Date Thu, 05 Sep 2013 10:12:53 GMT

    [ https://issues.apache.org/jira/browse/GIRAPH-448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13758965#comment-13758965
] 

Roman Grebennikov commented on GIRAPH-448:
------------------------------------------

Looks like that this issue is fixed by GIRAPH-666: Netty execs threads and metrics threads
don't get cleaned up properly.

Now there's no orphan processes after successful job termination.
                
> orphan process left on DataNode
> -------------------------------
>
>                 Key: GIRAPH-448
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-448
>             Project: Giraph
>          Issue Type: Bug
>          Components: mapreduce
>    Affects Versions: 0.1.0
>         Environment: Hadoop 1.0 with Fedora linux OS
>            Reporter: Min Tu
>
> I am able to run some simple Graph job successfully but there is one orphan process left
on the data node per job run.
> Please advise.
> Really appreciated your time and help.
> Min
> ----- details ------------------
> My job:
> hadoop jar /usr/local/giraph-0.1/lib/giraph-0.1.jar org.apache.giraph.examples.SimpleShortestPathsVertex
-Dgiraph.zkList="10.244.140.108:22181,10.244.141.225:22181,10.244.140.161:22181" -libjars
/usr/local/giraph-0.1//lib/guava-r09.jar,/usr/local/giraph-0.1//lib/zookeeper-3.3.3.jar,/home/mitu/jars/commons-io-2.1.jar,/home/mitu/json-20090211.jar,/home/mitu/gson-2.2.2.jar,/usr/local/giraph-0.1/lib/base64-2.3.8.jar
-Dquorum=d-sjc-00513560.corp.ebay.com /user/mitu/giraphData/sssp/input  /user/mitu/giraphData/sssp/output
1 2
> --------------
> Process left on the data node after job FINISHED successfully
> mapred   24885 24004  5 16:47 ?        00:00:04 /usr/java/jdk1.6.0_35/jre/bin/java -Djava.library.path=/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/native/Linux-amd64-64:/usr/local/hadoop01/scratch/taskTracker/mitu/jobcache/job_201212101618_0003/attempt_201212101618_0003_m_000001_0/work
-Xmx2g -Djava.io.tmpdir=/usr/local/hadoop01/scratch/taskTracker/mitu/jobcache/job_201212101618_0003/attempt_201212101618_0003_m_000001_0/work/tmp
-classpath /usr/local/hadoop-0.20.2-cdh3u4a/conf:/usr/java/default//lib/tools.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/..:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../hadoop-core-0.20.2-cdh3u4a.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/ant-contrib-1.0b3.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/aspectjrt-1.6.5.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/aspectjtools-1.6.5.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-cli-1.2.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-codec-1.4.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-daemon-1.0.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-el-1.0.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-httpclient-3.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-lang-2.4.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-logging-1.0.4.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-logging-api-1.0.4.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-net-3.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/core-3.1.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/guava-r09-jarjar.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/hadoop-fairscheduler-0.20.2-cdh3u4a.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/hsqldb-1.8.0.10.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jackson-core-asl-1.7.3.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jackson-mapper-asl-1.7.3.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jasper-compiler-5.5.12.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jasper-runtime-5.5.12.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jets3t-0.6.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jetty-6.1.26.cloudera.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jetty-servlet-tester-6.1.26.cloudera.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jetty-util-6.1.26.cloudera.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jsch-0.1.42.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/junit-4.5.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/kfs-0.2.2.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/log4j-1.2.15.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/mockito-all-1.8.2.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/oro-2.0.8.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/servlet-api-2.5-20081211.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/servlet-api-2.5-6.1.14.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/slf4j-api-1.4.3.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/slf4j-log4j12-1.4.3.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/xmlenc-0.52.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jsp-2.1/jsp-2.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jsp-2.1/jsp-api-2.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/conf/sflowagent.jar:/usr/local/hadoop01/scratch/taskTracker/mitu/jobcache/job_201212101618_0003/jars/classes:/usr/local/hadoop01/scratch/taskTracker/mitu/jobcache/job_201212101618_0003/jars/job.jar:/usr/local/hadoop01/scratch/taskTracker/mitu/distcache/-1938241819864817775_-1820091806_124600052/d-sjc-00513560.corp.ebay.com/tmp/hadoop-mapred/mapred/staging/mitu/.staging/job_201212101618_0003/libjars/guava-r09.jar:/usr/local/hadoop01/scratch/taskTracker/mitu/distcache/3379343582640146181_1388448658_124600217/d-sjc-00513560.corp.ebay.com/tmp/hadoop-mapred/mapred/staging/mitu/.staging/job_201212101618_0003/libjars/zookeeper-3.3.3.jar:/usr/local/hadoop01/scratch/taskTracker/mitu/distcache/8554092968028345678_-45346133_124600290/d-sjc-00513560.corp.ebay.com/tmp/hadoop-mapred/mapred/staging/mitu/.staging/job_201212101618_0003/libjars/commons-io-2.1.jar:/usr/local/hadoop01/scratch/taskTracker/mitu/distcache/-8215982196372453677_936989764_124600348/d-sjc-00513560.corp.ebay.com/tmp/hadoop-mapre
> mapred   25042 21916  0 16:48 pts/0    00:00:00 grep --color=auto 24885

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message