ok...@apache.org |
incubator-tinkerpop git commit: numerous tweaks trying to get things clean and clear. Added more tests to PersistedInputOutputRDDTest that show good long chain vertex programs with various degrees of Persist and Hadoop OLTP access, etc. Looking good. Sti |
Fri, 04 Dec, 18:14 |
spmalle...@apache.org |
incubator-tinkerpop git commit: TINKERPOP-1022 Preload OpProcessors in Gremlin Server. |
Fri, 04 Dec, 20:04 |
spmalle...@apache.org |
incubator-tinkerpop git commit: Moved transaction commit outside of iteration loop. |
Sun, 06 Dec, 20:58 |
ok...@apache.org |
[01/18] incubator-tinkerpop git commit: Adjusted ScriptEngines to "merge" bindings. |
Mon, 07 Dec, 16:00 |
ok...@apache.org |
[02/18] incubator-tinkerpop git commit: Provide the right expected schema on graph configuration in IoGraphTest. |
Mon, 07 Dec, 16:00 |
ok...@apache.org |
[03/18] incubator-tinkerpop git commit: Merge remote-tracking branch 'origin/master' into TINKERPOP3-860 |
Mon, 07 Dec, 16:00 |
ok...@apache.org |
[04/18] incubator-tinkerpop git commit: Loosened up assertions on types for toy graphs. |
Mon, 07 Dec, 16:00 |
ok...@apache.org |
[05/18] incubator-tinkerpop git commit: Merge branch 'TINKERPOP-992' |
Mon, 07 Dec, 16:00 |
ok...@apache.org |
[06/18] incubator-tinkerpop git commit: Merge remote-tracking branch 'origin/master' |
Mon, 07 Dec, 16:00 |
ok...@apache.org |
[07/18] incubator-tinkerpop git commit: realized a stupid bug in ToyGraphInputRDD around reduceByKey(). Fixed. Thanks @dalaro. CTR. |
Mon, 07 Dec, 16:00 |
ok...@apache.org |
[08/18] incubator-tinkerpop git commit: I merged the Hadoop PR and then the Column PR. Column PR had a conflict in integration testing in Spark cause of unregistered classes. Simple fix. CTR. |
Mon, 07 Dec, 16:00 |
ok...@apache.org |
[09/18] incubator-tinkerpop git commit: Improved the ability to control logging for maven builds. |
Mon, 07 Dec, 16:00 |
ok...@apache.org |
[10/18] incubator-tinkerpop git commit: Improved the ability to control logging for maven builds. |
Mon, 07 Dec, 16:00 |
ok...@apache.org |
[11/18] incubator-tinkerpop git commit: Merge remote-tracking branch 'origin/master' |
Mon, 07 Dec, 16:00 |
ok...@apache.org |
[12/18] incubator-tinkerpop git commit: Merge remote-tracking branch 'origin/master' into TINKERPOP3-860 |
Mon, 07 Dec, 16:00 |
ok...@apache.org |
[13/18] incubator-tinkerpop git commit: Added more to the silent logging configs. |
Mon, 07 Dec, 16:00 |
ok...@apache.org |
[14/18] incubator-tinkerpop git commit: TINKERPOP-1002 Rolled back transaction after asserted exception. |
Mon, 07 Dec, 16:00 |
ok...@apache.org |
[15/18] incubator-tinkerpop git commit: Merge remote-tracking branch 'origin/TINKERPOP3-860' |
Mon, 07 Dec, 16:00 |
ok...@apache.org |
[16/18] incubator-tinkerpop git commit: TINKERPOP-1022 Preload OpProcessors in Gremlin Server. |
Mon, 07 Dec, 16:00 |
ok...@apache.org |
[17/18] incubator-tinkerpop git commit: Moved transaction commit outside of iteration loop. |
Mon, 07 Dec, 16:00 |
ok...@apache.org |
[18/18] incubator-tinkerpop git commit: Merge branch 'master' into TINKERPOP3-1014 |
Mon, 07 Dec, 16:00 |
spmalle...@apache.org |
incubator-tinkerpop git commit: Moved logging setup to configuration. |
Mon, 07 Dec, 16:31 |
ok...@apache.org |
incubator-tinkerpop git commit: Path implementations are now smart about using FULL_PATH or just LABELED_PATH. Works for both OLTP and OLAP. |
Mon, 07 Dec, 17:11 |
ok...@apache.org |
[1/2] incubator-tinkerpop git commit: no more Step.getTraverserRequirements(). Crazy. There are a few odds and ends that need to be tweaked and cleaned. |
Mon, 07 Dec, 18:13 |
ok...@apache.org |
[2/2] incubator-tinkerpop git commit: no more Step.getTraverserRequirements(). Crazy. There are a few odds and ends that need to be tweaked and cleaned. |
Mon, 07 Dec, 18:13 |
ok...@apache.org |
incubator-tinkerpop git commit: Merge branch 'TINKERPOP-1025' into TINKERPOP-1027 |
Mon, 07 Dec, 18:28 |
spmalle...@apache.org |
incubator-tinkerpop git commit: TINKERPOP-1018 Fixed some settings that weren't being passed to Gremlin Driver Cluster creation through config file. |
Mon, 07 Dec, 18:30 |
spmalle...@apache.org |
[1/4] incubator-tinkerpop git commit: Deprecated Authenticator.newSaslNegotiator() and added new method to replace. |
Mon, 07 Dec, 18:55 |
spmalle...@apache.org |
[2/4] incubator-tinkerpop git commit: Update upgrade docs on Authenticator changes. |
Mon, 07 Dec, 18:55 |
spmalle...@apache.org |
[3/4] incubator-tinkerpop git commit: Updated changelog. |
Mon, 07 Dec, 18:55 |
spmalle...@apache.org |
[4/4] incubator-tinkerpop git commit: Merge remote-tracking branch 'origin/TINKERPOP3-995' |
Mon, 07 Dec, 18:55 |
ok...@apache.org |
incubator-tinkerpop git commit: hardcoded to not persisted contexts in integration testing to ensure that RDDs are not GC'd. CTR. |
Mon, 07 Dec, 20:20 |
ok...@apache.org |
incubator-tinkerpop git commit: I created Spark which is a class that maintains a HashMap of persisted RDDs to prevent Spark for garbage collecting them. This makes it so we can treat Spark like a file system where each RDD is saved indefinately. |
Mon, 07 Dec, 22:19 |
ok...@apache.org |
[1/3] incubator-tinkerpop git commit: I created Spark which is a class that maintains a HashMap of persisted RDDs to prevent Spark for garbage collecting them. This makes it so we can treat Spark like a file system where each RDD is saved indefinately. |
Mon, 07 Dec, 22:48 |
ok...@apache.org |
[2/3] incubator-tinkerpop git commit: Merge branch 'TINKERPOP-1025' into TINKERPOP-1027 |
Mon, 07 Dec, 22:48 |
ok...@apache.org |
[3/3] incubator-tinkerpop git commit: better control over RDD persistence. |
Mon, 07 Dec, 22:48 |
ok...@apache.org |
incubator-tinkerpop git commit: no need for SparkContextHelper anymore. Moved everything regarding persitent context management to the static Spark object. |
Mon, 07 Dec, 23:15 |
ok...@apache.org |
incubator-tinkerpop git commit: minor tweaks. Payload null check (can happen with persistent RDDs...) and clear out Spark cache for stale unpersited RDDs. |
Mon, 07 Dec, 23:50 |
ok...@apache.org |
incubator-tinkerpop git commit: various clean ups and organizations. This static Spark class was the way to go. Things now 'just work'. Finally. |
Tue, 08 Dec, 00:37 |
ok...@apache.org |
[1/7] incubator-tinkerpop git commit: Deprecated Authenticator.newSaslNegotiator() and added new method to replace. |
Tue, 08 Dec, 00:40 |
ok...@apache.org |
[2/7] incubator-tinkerpop git commit: Update upgrade docs on Authenticator changes. |
Tue, 08 Dec, 00:40 |
ok...@apache.org |
[3/7] incubator-tinkerpop git commit: Updated changelog. |
Tue, 08 Dec, 00:40 |
ok...@apache.org |
[4/7] incubator-tinkerpop git commit: TINKERPOP-1018 Fixed some settings that weren't being passed to Gremlin Driver Cluster creation through config file. |
Tue, 08 Dec, 00:40 |
ok...@apache.org |
[5/7] incubator-tinkerpop git commit: Merge remote-tracking branch 'origin/TINKERPOP3-995' |
Tue, 08 Dec, 00:40 |
ok...@apache.org |
[6/7] incubator-tinkerpop git commit: hardcoded to not persisted contexts in integration testing to ensure that RDDs are not GC'd. CTR. |
Tue, 08 Dec, 00:40 |
ok...@apache.org |
[7/7] incubator-tinkerpop git commit: Merge branch 'master' into TINKERPOP-1027 |
Tue, 08 Dec, 00:40 |
ok...@apache.org |
incubator-tinkerpop git commit: merged master but then use persisted contexts. |
Tue, 08 Dec, 00:41 |
ok...@apache.org |
incubator-tinkerpop git commit: removed wildcard import on statics. |
Tue, 08 Dec, 13:44 |
ok...@apache.org |
[01/13] incubator-tinkerpop git commit: mapReduceRDD makes use of a post view merge. @dalaro realized this was important prior to graph writing. Thus, moved the view merge to pre-mapreduce and pre-graph output. Added more rigorous property checking to Pa |
Tue, 08 Dec, 13:47 |
ok...@apache.org |
[02/13] incubator-tinkerpop git commit: numerous tweaks trying to get things clean and clear. Added more tests to PersistedInputOutputRDDTest that show good long chain vertex programs with various degrees of Persist and Hadoop OLTP access, etc. Looking g |
Tue, 08 Dec, 13:47 |
ok...@apache.org |
[03/13] incubator-tinkerpop git commit: Merge branch 'TINKERPOP-1025' into TINKERPOP-1027 |
Tue, 08 Dec, 13:47 |
ok...@apache.org |
[04/13] incubator-tinkerpop git commit: I created Spark which is a class that maintains a HashMap of persisted RDDs to prevent Spark for garbage collecting them. This makes it so we can treat Spark like a file system where each RDD is saved indefinately. |
Tue, 08 Dec, 13:47 |
ok...@apache.org |
[05/13] incubator-tinkerpop git commit: Merge branch 'TINKERPOP-1025' into TINKERPOP-1027 |
Tue, 08 Dec, 13:47 |
ok...@apache.org |
[06/13] incubator-tinkerpop git commit: better control over RDD persistence. |
Tue, 08 Dec, 13:47 |
ok...@apache.org |
[07/13] incubator-tinkerpop git commit: no need for SparkContextHelper anymore. Moved everything regarding persitent context management to the static Spark object. |
Tue, 08 Dec, 13:47 |
ok...@apache.org |
[08/13] incubator-tinkerpop git commit: minor tweaks. Payload null check (can happen with persistent RDDs...) and clear out Spark cache for stale unpersited RDDs. |
Tue, 08 Dec, 13:47 |
ok...@apache.org |
[09/13] incubator-tinkerpop git commit: various clean ups and organizations. This static Spark class was the way to go. Things now 'just work'. Finally. |
Tue, 08 Dec, 13:47 |
ok...@apache.org |
[10/13] incubator-tinkerpop git commit: Merge branch 'master' into TINKERPOP-1027 |
Tue, 08 Dec, 13:47 |
ok...@apache.org |
[11/13] incubator-tinkerpop git commit: merged master but then use persisted contexts. |
Tue, 08 Dec, 13:47 |
ok...@apache.org |
[12/13] incubator-tinkerpop git commit: removed wildcard import on statics. |
Tue, 08 Dec, 13:47 |
ok...@apache.org |
[13/13] incubator-tinkerpop git commit: updated CHANGELOG. |
Tue, 08 Dec, 13:47 |
ok...@apache.org |
incubator-tinkerpop git commit: fist push on a Spark object for managing persisted RDDs. Not finished yet. |
Tue, 08 Dec, 15:01 |
ok...@apache.org |
incubator-tinkerpop git commit: Fixed a NullPointerException in PeerPressureVertexProgram. PageRankVertexProgram had the null pointer check and PeerPressure did not. Added PeerPressureVertexProgramTest to ProcessComputeSuite. Ingeration tested Spark. CTR |
Tue, 08 Dec, 15:17 |
ok...@apache.org |
[1/2] incubator-tinkerpop git commit: Fixed a NullPointerException in PeerPressureVertexProgram. PageRankVertexProgram had the null pointer check and PeerPressure did not. Added PeerPressureVertexProgramTest to ProcessComputeSuite. Ingeration tested Spar |
Tue, 08 Dec, 15:29 |
ok...@apache.org |
[2/2] incubator-tinkerpop git commit: Merge branch 'master' into TINKERPOP-1023 |
Tue, 08 Dec, 15:29 |
ok...@apache.org |
incubator-tinkerpop git commit: added Spark persited RDD utility that can be spark.ls(), spark.head(), spark.rm(), spark.describe(), etc. in the Console. Really cool. Added a SparkGremlinPluginTest that verifies everything works as expected. Updated docs |
Tue, 08 Dec, 16:28 |
ok...@apache.org |
svn commit: r1718651 - in /incubator/tinkerpop/site: docs/3.1.1-SNAPSHOT/ javadocs/3.1.1-SNAPSHOT/ |
Tue, 08 Dec, 17:11 |
ok...@apache.org |
incubator-tinkerpop git commit: added spark RDD utility to docs. |
Tue, 08 Dec, 17:12 |
ok...@apache.org |
incubator-tinkerpop git commit: minor section rename. |
Tue, 08 Dec, 17:16 |
ok...@apache.org |
incubator-tinkerpop git commit: removed debugging work in SparkTest. |
Tue, 08 Dec, 17:24 |
ok...@apache.org |
svn commit: r1718653 - in /incubator/tinkerpop/site: docs/3.1.1-SNAPSHOT/ docs/3.1.1-SNAPSHOT/dev/ docs/3.1.1-SNAPSHOT/dev/developer/ docs/3.1.1-SNAPSHOT/images/ docs/3.1.1-SNAPSHOT/images/icons/ docs/3.1.1-SNAPSHOT/reference/ docs/3.1.1-SNAPSHOT/tutor... |
Tue, 08 Dec, 17:26 |
ok...@apache.org |
incubator-tinkerpop git commit: minor nothing. just in case the filesystem gives back a name with a space. |
Tue, 08 Dec, 18:13 |
ok...@apache.org |
[1/2] incubator-tinkerpop git commit: minor nothing. just in case the filesystem gives back a name with a space. |
Tue, 08 Dec, 18:14 |
ok...@apache.org |
[2/2] incubator-tinkerpop git commit: Merge branch 'master' into TINKERPOP-1023 |
Tue, 08 Dec, 18:14 |
ok...@apache.org |
incubator-tinkerpop git commit: added a nice error message if Spark hasn't been created. Much better than NullPointerException. |
Tue, 08 Dec, 18:49 |
ok...@apache.org |
incubator-tinkerpop git commit: removed named RDDs. No point as they are not going to be cached. |
Tue, 08 Dec, 20:17 |
ok...@apache.org |
incubator-tinkerpop git commit: minor nothing. |
Tue, 08 Dec, 23:24 |
ok...@apache.org |
incubator-tinkerpop git commit: BVLP problem with InputRDD was not a real problem. It had to do with workers=1 and local[4]. This is ticket TINKERPOP-1025. Will merge with this work given that its so simple and all related. |
Wed, 09 Dec, 00:00 |
ok...@apache.org |
incubator-tinkerpop git commit: provided a general way to ensure that the number of parititions is NOT larger than the number of workers. Moreover RDD.coalesce() does not require a shuffle as it only handle partition reduction. |
Wed, 09 Dec, 00:25 |
spmalle...@apache.org |
incubator-tinkerpop git commit: Improved consistency of transaction management in gremlin server. |
Wed, 09 Dec, 00:52 |
spmalle...@apache.org |
incubator-tinkerpop git commit: Moved extra logging config to properties files. |
Wed, 09 Dec, 11:03 |
spmalle...@apache.org |
incubator-tinkerpop git commit: Add in some upgrade docs around logging. |
Wed, 09 Dec, 11:44 |
ok...@apache.org |
[01/14] incubator-tinkerpop git commit: fist push on a Spark object for managing persisted RDDs. Not finished yet. |
Wed, 09 Dec, 13:51 |
ok...@apache.org |
[02/14] incubator-tinkerpop git commit: Merge branch 'master' into TINKERPOP-1023 |
Wed, 09 Dec, 13:51 |
ok...@apache.org |
[03/14] incubator-tinkerpop git commit: added Spark persited RDD utility that can be spark.ls(), spark.head(), spark.rm(), spark.describe(), etc. in the Console. Really cool. Added a SparkGremlinPluginTest that verifies everything works as expected. Upda |
Wed, 09 Dec, 13:51 |
ok...@apache.org |
[04/14] incubator-tinkerpop git commit: added spark RDD utility to docs. |
Wed, 09 Dec, 13:51 |
ok...@apache.org |
[05/14] incubator-tinkerpop git commit: minor section rename. |
Wed, 09 Dec, 13:51 |
ok...@apache.org |
[06/14] incubator-tinkerpop git commit: removed debugging work in SparkTest. |
Wed, 09 Dec, 13:51 |
ok...@apache.org |
[07/14] incubator-tinkerpop git commit: Merge branch 'master' into TINKERPOP-1023 |
Wed, 09 Dec, 13:51 |
ok...@apache.org |
[08/14] incubator-tinkerpop git commit: added a nice error message if Spark hasn't been created. Much better than NullPointerException. |
Wed, 09 Dec, 13:51 |
ok...@apache.org |
[09/14] incubator-tinkerpop git commit: removed named RDDs. No point as they are not going to be cached. |
Wed, 09 Dec, 13:51 |
ok...@apache.org |
[10/14] incubator-tinkerpop git commit: minor nothing. |
Wed, 09 Dec, 13:51 |
ok...@apache.org |
[11/14] incubator-tinkerpop git commit: BVLP problem with InputRDD was not a real problem. It had to do with workers=1 and local[4]. This is ticket TINKERPOP-1025. Will merge with this work given that its so simple and all related. |
Wed, 09 Dec, 13:51 |
ok...@apache.org |
[12/14] incubator-tinkerpop git commit: provided a general way to ensure that the number of parititions is NOT larger than the number of workers. Moreover RDD.coalesce() does not require a shuffle as it only handle partition reduction. |
Wed, 09 Dec, 13:51 |
ok...@apache.org |
[13/14] incubator-tinkerpop git commit: worker regulation based on coalesce. |
Wed, 09 Dec, 13:51 |
ok...@apache.org |
[14/14] incubator-tinkerpop git commit: updated CHANGELOG and upgrade docs. |
Wed, 09 Dec, 13:51 |
ok...@apache.org |
incubator-tinkerpop git commit: added a many-to-one note about reducing barrier steps in the docs. CTR. |
Wed, 09 Dec, 14:41 |
ok...@apache.org |
incubator-tinkerpop git commit: fixed a SparkGraphComputer sorting bug in MapReduce that occurred when there is more than one graph partition. This was exposed by ToyGraphInputRDD which is a 4 partition. We never saw this before cause all the InputFormat |
Wed, 09 Dec, 15:14 |
spmalle...@apache.org |
[1/5] incubator-tinkerpop git commit: Moved logging setup to configuration. |
Wed, 09 Dec, 16:27 |
spmalle...@apache.org |
[2/5] incubator-tinkerpop git commit: Moved extra logging config to properties files. |
Wed, 09 Dec, 16:27 |