giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Claudio Martella <claudio.marte...@gmail.com>
Subject Re: Review Request: Jython for Giraph
Date Tue, 11 Jun 2013 06:24:00 GMT
probably this would make sense the hadoop-streaming way through the
distributed cache via command-line?


On Tue, Jun 11, 2013 at 7:52 AM, Nitay Joffe <nitay@apache.org> wrote:

>
>
> > On June 11, 2013, 5:51 a.m., Nitay Joffe wrote:
> > > Regarding your comment - yeah I'll add it to GiraphRunner. Right now
> you have to specify at the very least the types IVEMM, the python script
> path (as resource in jar) and the computation class name. Any thoughts how
> to make this simpler?
>
> Also I can make it support python files not shipped inside jar (assuming
> the user knows to make the same path available on all their nodes). I find
> it is easier management/deployment wise to ship the python scripts as
> resources and load them that way.
>
>
> - Nitay
>
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/11709/#review21693
> -----------------------------------------------------------
>
>
> On June 10, 2013, 6:55 a.m., Nitay Joffe wrote:
> >
> > -----------------------------------------------------------
> > This is an automatically generated e-mail. To reply, visit:
> > https://reviews.apache.org/r/11709/
> > -----------------------------------------------------------
> >
> > (Updated June 10, 2013, 6:55 a.m.)
> >
> >
> > Review request for giraph.
> >
> >
> > Description
> > -------
> >
> > See JIRA
> >
> >
> > This addresses bug GIRAPH-683.
> >     https://issues.apache.org/jira/browse/GIRAPH-683
> >
> >
> > Diffs
> > -----
> >
> >   giraph-core/pom.xml 3ffe175b675d5be1d878d83d37a04935d30130d6
> >
> giraph-core/src/main/java/org/apache/giraph/benchmark/BenchmarkOption.java
> 23c614b1112dd455a97b6ee7d32188dc5a5fd574
> >
> giraph-core/src/main/java/org/apache/giraph/benchmark/PageRankBenchmark.java
> bd2939ec4ce9d3fa373fda667e75df7e0da1cc82
> >
> giraph-core/src/main/java/org/apache/giraph/conf/AbstractConfOption.java
> d00f7e908605d8753eb129d0173cf1980034dcc9
> >
> giraph-core/src/main/java/org/apache/giraph/conf/BooleanConfOption.java
> c16ec8849641847d53aea8c90dcc0a3fcd646e45
> >   giraph-core/src/main/java/org/apache/giraph/conf/ClassConfOption.java
> 41d120b18bdbbf13c8426ec49f8619d273684620
> >   giraph-core/src/main/java/org/apache/giraph/conf/ConfOptionType.java
> 8f70d904660f14370c2e5c98cc59b6a48ea18135
> >   giraph-core/src/main/java/org/apache/giraph/conf/EnumConfOption.java
> PRE-CREATION
> >   giraph-core/src/main/java/org/apache/giraph/conf/FloatConfOption.java
> fa21a281525858208b1ee81be1eafa5ddcb22a0f
> >   giraph-core/src/main/java/org/apache/giraph/conf/GiraphClasses.java
> 621bb14e4962ec9326c3d58b9de33ad83eb23621
> >
> giraph-core/src/main/java/org/apache/giraph/conf/GiraphConfiguration.java
> 58a3f0179d17cd04f2e69789a6e3838cb22d75eb
> >   giraph-core/src/main/java/org/apache/giraph/conf/GiraphConstants.java
> 2d0f59cecfdf580609c9d6373c0878c90cede430
> >   giraph-core/src/main/java/org/apache/giraph/conf/GiraphTypes.java
> PRE-CREATION
> >
> giraph-core/src/main/java/org/apache/giraph/conf/ImmutableClassesGiraphConfiguration.java
> aa5249875de551a341a4baac894c68553cbd6e63
> >   giraph-core/src/main/java/org/apache/giraph/conf/IntConfOption.java
> de75e9dc4d1696b11251a8e8cac870f6bbf72230
> >   giraph-core/src/main/java/org/apache/giraph/conf/LongConfOption.java
> 0cbc164756de8a422a8f23f01809200b4d569cbf
> >   giraph-core/src/main/java/org/apache/giraph/conf/StrConfOption.java
> 83a583d98820ef946258d2e2a14fc279583b5c5c
> >   giraph-core/src/main/java/org/apache/giraph/graph/Computation.java
> 84158df3ded55360af179e08194e14bc43949c77
> >
> giraph-core/src/main/java/org/apache/giraph/graph/ComputationFactory.java
> PRE-CREATION
> >
> giraph-core/src/main/java/org/apache/giraph/graph/ComputationLanguage.java
> PRE-CREATION
> >
> giraph-core/src/main/java/org/apache/giraph/graph/DefaultComputationFactory.java
> PRE-CREATION
> >
> giraph-core/src/main/java/org/apache/giraph/graph/GraphTaskManager.java
> 99b28df74232504f2b2a16639473e367f53dd15f
> >
> giraph-core/src/main/java/org/apache/giraph/job/GiraphConfigurationValidator.java
> de17157dcbeb123fc43184742a59ed1116070dd6
> >   giraph-core/src/main/java/org/apache/giraph/jython/Jython.java
> PRE-CREATION
> >
> giraph-core/src/main/java/org/apache/giraph/jython/JythonComputationFactory.java
> PRE-CREATION
> >   giraph-core/src/main/java/org/apache/giraph/jython/package-info.java
> PRE-CREATION
> >
> giraph-core/src/main/java/org/apache/giraph/master/SuperstepClasses.java
> a12ef58eec93aa4e801955efcd42f0e5c899275e
> >
> giraph-core/src/main/java/org/apache/giraph/utils/ConfigurationUtils.java
> d8b121b14c93cd8b2c0664ab23c2af6d3c5b6415
> >   giraph-core/src/main/java/org/apache/giraph/utils/FileUtils.java
> 442fc9f068c4478706e96a726c5caa2f8fda4563
> >
> giraph-core/src/main/java/org/apache/giraph/utils/InternalVertexRunner.java
> b4920e1a015eda3ea5d5c381d5b0155f38f1891a
> >   giraph-core/src/main/java/org/apache/giraph/utils/ReflectionUtils.java
> 96352bbfc0901e44ffe25bbe2f280a216c797131
> >
> giraph-core/src/main/resources/org/apache/giraph/benchmark/page-rank.py
> PRE-CREATION
> >   giraph-core/src/test/java/org/apache/giraph/jython/TestJython.java
> PRE-CREATION
> >
> giraph-core/src/test/java/org/apache/giraph/utils/TestReflectionUtils.java
> PRE-CREATION
> >   giraph-core/src/test/resources/org/apache/giraph/jython/count-edges.py
> PRE-CREATION
> >   giraph-hive/src/main/java/org/apache/giraph/hive/HiveGiraphRunner.java
> 340b4618ce8fdd4ec2303866b2ded632535e40a4
> >   pom.xml 0bd85a45f2b26d34c0eacd2ecd7068fefccbb91b
> >
> > Diff: https://reviews.apache.org/r/11709/diff/
> >
> >
> > Testing
> > -------
> >
> >
> > Thanks,
> >
> > Nitay Joffe
> >
> >
>
>


-- 
   Claudio Martella
   claudio.martella@gmail.com

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message