giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GIRAPH-944) Improve job tracking on command line
Date Tue, 26 Aug 2014 23:01:59 GMT

    [ https://issues.apache.org/jira/browse/GIRAPH-944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111516#comment-14111516
] 

Hudson commented on GIRAPH-944:
-------------------------------

FAILURE: Integrated in Giraph-trunk-Commit #1484 (See [https://builds.apache.org/job/Giraph-trunk-Commit/1484/])
GIRAPH-944: Improve job tracking on command line (majakabiljo: http://git-wip-us.apache.org/repos/asf?p=giraph.git&a=commit&h=4485e563a6582afb1c848ea80888fdad50ada516)
* giraph-core/src/main/java/org/apache/giraph/graph/JobProgressTrackerClientNoOp.java
* giraph-core/src/main/java/org/apache/giraph/job/GiraphJob.java
* giraph-core/src/main/java/org/apache/giraph/graph/JobProgressTrackerClient.java
* giraph-core/src/main/java/org/apache/giraph/job/JobProgressTracker.java
* giraph-core/src/main/java/org/apache/giraph/graph/GraphTaskManager.java
* giraph-core/pom.xml
* giraph-core/src/main/java/org/apache/giraph/job/JobProgressTrackerService.java
* giraph-core/src/main/java/org/apache/giraph/master/MasterCompute.java
* giraph-core/src/main/java/org/apache/giraph/conf/GiraphConstants.java
* giraph-core/src/main/java/org/apache/giraph/bsp/BspService.java
* giraph-core/src/main/java/org/apache/giraph/graph/RetryableJobProgressTrackerClient.java
* giraph-examples/pom.xml
* giraph-hive/src/main/java/org/apache/giraph/hive/jython/HiveJythonUtils.java
* giraph-examples/src/test/java/org/apache/giraph/TestBspBasic.java
* giraph-core/src/main/java/org/apache/giraph/master/BspServiceMaster.java
* pom.xml
* giraph-core/src/main/java/org/apache/giraph/zk/ZooKeeperManager.java
* giraph-core/src/main/java/org/apache/giraph/worker/WorkerProgressWriter.java
* giraph-core/src/main/java/org/apache/giraph/worker/BspServiceWorker.java
* giraph-core/src/main/java/org/apache/giraph/worker/WorkerContext.java
* giraph-core/src/main/java/org/apache/giraph/bsp/CentralizedService.java
* giraph-core/src/test/java/org/apache/giraph/BspCase.java
* giraph-core/src/main/java/org/apache/giraph/worker/WorkerProgress.java
* giraph-core/src/main/java/org/apache/giraph/utils/FileUtils.java
* giraph-core/src/main/java/org/apache/giraph/scripting/ScriptLoader.java


> Improve job tracking on command line
> ------------------------------------
>
>                 Key: GIRAPH-944
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-944
>             Project: Giraph
>          Issue Type: Improvement
>            Reporter: Maja Kabiljo
>            Assignee: Maja Kabiljo
>         Attachments: GIRAPH-944.patch
>
>
> Currently job client connects to Zookeeper and uses information from there to report
progress on the command line. This means that if job fails there is no way for app to communicate
back to job client why it failed, and also bunch of zookeeper exceptions gets thrown. 
> Instead, we can use swift as a channel of communication between job client and master/workers.
Also we can allow for MasterCompute/WorkerContext to print info directly to command line -
is useful to report app related progress or for debugging.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message