Return-Path: X-Original-To: apmail-incubator-giraph-dev-archive@minotaur.apache.org Delivered-To: apmail-incubator-giraph-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id AA8B27CD6 for ; Thu, 27 Oct 2011 02:03:56 +0000 (UTC) Received: (qmail 67546 invoked by uid 500); 27 Oct 2011 02:03:56 -0000 Delivered-To: apmail-incubator-giraph-dev-archive@incubator.apache.org Received: (qmail 67515 invoked by uid 500); 27 Oct 2011 02:03:56 -0000 Mailing-List: contact giraph-dev-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: giraph-dev@incubator.apache.org Delivered-To: mailing list giraph-dev@incubator.apache.org Received: (qmail 67504 invoked by uid 99); 27 Oct 2011 02:03:56 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 27 Oct 2011 02:03:56 +0000 X-ASF-Spam-Status: No, hits=-2000.5 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 27 Oct 2011 02:03:53 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id D39E831DB75 for ; Thu, 27 Oct 2011 02:01:33 +0000 (UTC) Date: Thu, 27 Oct 2011 02:01:33 +0000 (UTC) From: "Owen O'Malley (Commented) (JIRA)" To: giraph-dev@incubator.apache.org Message-ID: <90789645.22358.1319680893868.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <503758822.16217.1319593952110.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (GIRAPH-64) Create VertexRunner to make it easier to run users' computations MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/GIRAPH-64?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13136704#comment-13136704 ] Owen O'Malley commented on GIRAPH-64: ------------------------------------- I guess I should expand on that a bit. So the standard giraph main should build up the job and submit it and just provide a cli option to override the vertex and automatically put both the giraph.jar and my-awesome.jar into the dist cache. > Create VertexRunner to make it easier to run users' computations > ---------------------------------------------------------------- > > Key: GIRAPH-64 > URL: https://issues.apache.org/jira/browse/GIRAPH-64 > Project: Giraph > Issue Type: New Feature > Reporter: Jakob Homan > > Currently, if a user wants to implement a Giraph algorithm by extending {{Vertex}} they must also write all the boilerplate around the {{Tool}} interface and bundle it with the Giraph jar (or get Giraph on the classpath and playing nice with the implementation). For example, what is included in the PageRankBenchmark and what Kohei has done: https://github.com/smly/java-Giraph-LabelPropagation It would be better if we had perhaps a Vertex implementation to be subclassed that already had all the standard Tooling included such that all one had to run would be (assuming the Giraph jar was already on the classpath): > {noformat}hadoop jar my-awesome-vertex.jar my.awesome.vertex -i jazz_input -o jazz_output -if org.apache.giraph.lib.in.text.adjacency-list.LongDoubleDouble -of org.apache.giraph.lib.out.text.adjacency-list.LongDoubleDouble{noformat} This wouldn't work with every algorithm, but would be useful in a large number of cases. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira