tinkerpop-commits mailing list archives: January 2017

Site index · List index
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · Next »Thread · Author · Date
ok...@apache.org [01/24] tinkerpop git commit: if the System.getProperty() has a shim-service set, then it is also set as a DRIVER_JAVA_OPTIONS and an EXECUTOR_JAVA_OPTIONS in SparkGraphComputer (this is necessary for Spark 2.0). Also, some is.testing class registrations Tue, 03 Jan, 14:43
ok...@apache.org   [02/24] tinkerpop git commit: TINKERPOP-1389 Support Spark 2.0 Tue, 03 Jan, 14:43
ok...@apache.org   [03/24] tinkerpop git commit: @dalaro provided an update to KryoShimServiceLoader via a gist as the LOG message was not so clear. Tue, 03 Jan, 14:43
ok...@apache.org   [04/24] tinkerpop git commit: had to go back down to Hadoop 2.7.2 because Hadoop 2.7.3 changed a method signature that GiraphJob calls and thus, Giraph fails. Dar. Cleaned up pom.xmls a bit and updated CHANGELOG. This branch is ready to be tested on the Tue, 03 Jan, 14:43
ok...@apache.org   [05/24] tinkerpop git commit: jesus. that was a depedency hell like only spark can provide. got SparkServer working with GremlinConsole and HDFS. Phew... Also, bumped to Hadoop 2.7.3 (from 2.7.2). Tue, 03 Jan, 14:43
ok...@apache.org   [06/24] tinkerpop git commit: GryoSerializer uses HadoopPools so that gryo pools are not constantly produced (object reused stylie). This have increased the performance of GryoSerializer based jobs to that of the 3.2.x line prior to bumping to Spark 2.0. Tue, 03 Jan, 14:43
ok...@apache.org   [07/24] tinkerpop git commit: minor nothing to GiraphGraphComputer. Tue, 03 Jan, 14:43
ok...@apache.org   [08/24] tinkerpop git commit: UnshadedKryoShimService is now the default for SparkGraphComputer. Users no longer have to System.setProperty() as its all handled in the SparkGraphComputer constructor. I would really like to get rid of the 'service model' Tue, 03 Jan, 14:43
ok...@apache.org   [09/24] tinkerpop git commit: added SystemUtil to gremlin-core which is able to generate Configurations from System.properties. Useful in Hadoop GraphComputer settings where JVMs can have IO configuration information in them. HadoopPools will now try and Tue, 03 Jan, 14:43
ok...@apache.org   [10/24] tinkerpop git commit: Decoupled GryoRecordReader/Writer from KryoShimService. The shim service should ONLY be for inter-process communication -- not input/output formats. cc/ @dalaro Tue, 03 Jan, 14:43
ok...@apache.org   [11/24] tinkerpop git commit: Avoid starting VP worker iterations that never end Tue, 03 Jan, 14:43
ok...@apache.org   [12/24] tinkerpop git commit: Really simplified UnshadedKryoShimService and IoRegistryAwareKryoSerializer. Also, introduced a synchronization point in KryoServiceLoader.applyConfiguration() as I believe that multiple threads are creating a service over a Tue, 03 Jan, 14:43
ok...@apache.org   [13/24] tinkerpop git commit: using tinkerpop as the prefix for System property configurations. Tweaked the KryoShimServiceLoader's logging information so its easier to see whats going on --- doing cluster testing. Tue, 03 Jan, 14:43
ok...@apache.org   [14/24] tinkerpop git commit: lots of good stuff here -- finally have testing of IORegistry in SparkGraphComputer. Have ToyPoint and TestIoRegistry. Realized a bunch of stupid .flush() calls in the GryoSerializer serializers (Spark)... perhaps that is wh Tue, 03 Jan, 14:44
ok...@apache.org   [15/24] tinkerpop git commit: Added AbstractIoRegistryCheck that verifies the IoRegistry of test-types (ToyPoint and ToyTriangle) work for OLTP, OLAP, and Storage streaming on all Hadoop-based graphs (Giraph/Spark). Currently, it only checks Gryo regitra Tue, 03 Jan, 14:44
ok...@apache.org   [16/24] tinkerpop git commit: dah. sorry. had some work I started doing before the previous commit. reverting. Tue, 03 Jan, 14:44
ok...@apache.org   [17/24] tinkerpop git commit: KryoShimServices now implement .close() so they can relinquish resources. KryoShimServiceLoader also implements close() and will close any static shim service it maintains. On a force reload, any existing KryoShimService is Tue, 03 Jan, 14:44
ok...@apache.org   [18/24] tinkerpop git commit: weird necessity. will figure out cause later. Tue, 03 Jan, 14:44
ok...@apache.org   [19/24] tinkerpop git commit: okay. so I found a bug that has to do with joins() in Spark and IoRegistry.... I thought this whole time it was from me -- but then I realized that I added a .out() to the test. I reverted to an older version of the branch a Tue, 03 Jan, 14:44
ok...@apache.org   [20/24] tinkerpop git commit: Limit JVM system props passed around in Spark jobs Tue, 03 Jan, 14:44
ok...@apache.org   [21/24] tinkerpop git commit: No more IoAwareSerializer -- it doens't work in Spark 2.0's serialization model. GryoRegistrar is now responsible for handling IoRegistry registration. Much simpler. Finally, everything is passing -- both GryoSerializer and Tue, 03 Jan, 14:44
ok...@apache.org   [22/24] tinkerpop git commit: tweaks to IoRegistryHelper now that instance() is the default instead of getInstance(). Minor tweaks here and there otheriwse. Rebased with master/. Tue, 03 Jan, 14:44
ok...@apache.org   [23/24] tinkerpop git commit: fixed a bug in the CHANGELOG and added a few more things. Tue, 03 Jan, 14:44
ok...@apache.org   [24/24] tinkerpop git commit: merged Spark 2.0.0 work. Massive undertaking that provided us performance improvements. Thanks @dalaro and @yucx. Tue, 03 Jan, 14:44
spmalle...@apache.org tinkerpop git commit: TINKERPOP-1130 Removed incompatibility notes concept. Tue, 03 Jan, 15:07
spmalle...@apache.org [01/50] [abbrv] tinkerpop git commit: Really simplified UnshadedKryoShimService and IoRegistryAwareKryoSerializer. Also, introduced a synchronization point in KryoServiceLoader.applyConfiguration() as I believe that multiple threads are creating a servic [Forced Update!] Tue, 03 Jan, 15:44
spmalle...@apache.org   [02/50] [abbrv] tinkerpop git commit: Limit JVM system props passed around in Spark jobs Tue, 03 Jan, 15:44
spmalle...@apache.org   [03/50] [abbrv] tinkerpop git commit: No more IoAwareSerializer -- it doens't work in Spark 2.0's serialization model. GryoRegistrar is now responsible for handling IoRegistry registration. Much simpler. Finally, everything is passing -- both GryoSeriali Tue, 03 Jan, 15:44
spmalle...@apache.org   [04/50] [abbrv] tinkerpop git commit: okay. so I found a bug that has to do with joins() in Spark and IoRegistry.... I thought this whole time it was from me -- but then I realized that I added a .out() to the test. I reverted to an older version of the Tue, 03 Jan, 15:44
spmalle...@apache.org   [05/50] [abbrv] tinkerpop git commit: tweaks to IoRegistryHelper now that instance() is the default instead of getInstance(). Minor tweaks here and there otheriwse. Rebased with master/. Tue, 03 Jan, 15:44
spmalle...@apache.org   [06/50] [abbrv] tinkerpop git commit: fixed a bug in the CHANGELOG and added a few more things. Tue, 03 Jan, 15:44
spmalle...@apache.org   [07/50] [abbrv] tinkerpop git commit: merged Spark 2.0.0 work. Massive undertaking that provided us performance improvements. Thanks @dalaro and @yucx. Tue, 03 Jan, 15:44
spmalle...@apache.org   [08/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Structured the IO compatibility tests Tue, 03 Jan, 15:44
spmalle...@apache.org   [09/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Structured the IO compatibility tests Tue, 03 Jan, 15:44
spmalle...@apache.org   [10/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Structured the IO compatibility tests Tue, 03 Jan, 15:44
spmalle...@apache.org   [11/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Structured the IO compatibility tests Tue, 03 Jan, 15:44
spmalle...@apache.org   [12/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Structured the IO compatibility tests Tue, 03 Jan, 15:44
spmalle...@apache.org   [13/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Structured the IO compatibility tests Tue, 03 Jan, 15:44
spmalle...@apache.org   [14/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Structured the IO compatibility tests Tue, 03 Jan, 15:44
spmalle...@apache.org   [15/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Structured the IO compatibility tests Tue, 03 Jan, 15:44
spmalle...@apache.org   [16/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Get the basics of Gryo 3.0 in place. Tue, 03 Jan, 15:44
spmalle...@apache.org   [17/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Get the basics of Gryo 3.0 in place. Tue, 03 Jan, 15:44
spmalle...@apache.org   [18/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Made the test data for metrics static. Tue, 03 Jan, 15:44
spmalle...@apache.org   [19/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Implemented many additional IO tests. Tue, 03 Jan, 15:44
spmalle...@apache.org   [20/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Implemented many additional IO tests. Tue, 03 Jan, 15:44
spmalle...@apache.org   [21/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Completed tests for typed IO Tue, 03 Jan, 15:44
spmalle...@apache.org   [22/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Changed scope of gremlin-test to "test" Tue, 03 Jan, 15:44
spmalle...@apache.org   [23/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Improved asserts on Graph elements. Tue, 03 Jan, 15:44
spmalle...@apache.org   [24/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Added more asserts for Element related tests Tue, 03 Jan, 15:44
spmalle...@apache.org   [25/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Add gremlin-test back as compile scope. Tue, 03 Jan, 15:44
spmalle...@apache.org   [26/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Enabled testing of int/double for GraphSON Tue, 03 Jan, 15:44
spmalle...@apache.org   [27/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Enabled GraphSON serialization tests for enums Tue, 03 Jan, 15:44
spmalle...@apache.org   [28/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Add 3.2.4 data files for gremlin-io-test Tue, 03 Jan, 15:44
spmalle...@apache.org   [29/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Add 3.2.4 data files for gremlin-io-test Tue, 03 Jan, 15:44
spmalle...@apache.org   [30/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Add 3.2.4 data files for gremlin-io-test Tue, 03 Jan, 15:44
spmalle...@apache.org   [31/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Add 3.2.4 data files for gremlin-io-test Tue, 03 Jan, 15:44
spmalle...@apache.org   [32/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Added test support for ConjunctiveP in Gryo Tue, 03 Jan, 15:44
spmalle...@apache.org   [33/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Fixed ByteBuffer compatibility with Gryo. Tue, 03 Jan, 15:44
spmalle...@apache.org   [34/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Enable more tests on gryo 1.0 and 3.3.0. Tue, 03 Jan, 15:44
spmalle...@apache.org   [35/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Added TinkerGraph support in gremlin-io-test Tue, 03 Jan, 15:44
spmalle...@apache.org   [36/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Added "incompatibility notes" Tue, 03 Jan, 15:44
spmalle...@apache.org   [37/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Tests for edge untyped graphson Tue, 03 Jan, 15:44
spmalle...@apache.org   [38/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Add Compatiblities helper class Tue, 03 Jan, 15:44
spmalle...@apache.org   [39/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Regenerated IO docs for GraphSON Tue, 03 Jan, 15:44
spmalle...@apache.org   [40/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Revised the model for Tree Tue, 03 Jan, 15:44
spmalle...@apache.org   [41/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Added Request/ResponseMessage incompatibilty reasons. Tue, 03 Jan, 15:44
spmalle...@apache.org   [42/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Testing for Path untyped GraphSON Tue, 03 Jan, 15:44
spmalle...@apache.org   [43/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Added back graphson generation script for 3.2.4 Tue, 03 Jan, 15:44
spmalle...@apache.org   [44/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Finished tests for untyped structure elements. Tue, 03 Jan, 15:44
spmalle...@apache.org   [45/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Cleaned up compatibility definitions Tue, 03 Jan, 15:44
spmalle...@apache.org   [46/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Removed incompatibility notes concept. Tue, 03 Jan, 15:44
spmalle...@apache.org   [47/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Completed GraphSON tests for Request/ResponseMessage Tue, 03 Jan, 15:44
spmalle...@apache.org   [48/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Move common compatibility filters to Compatibilities Tue, 03 Jan, 15:44
spmalle...@apache.org   [49/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Added configuration filter for Compatibilities Tue, 03 Jan, 15:44
spmalle...@apache.org   [50/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Removed support for testing "time" with untyped GraphSON Tue, 03 Jan, 15:44
ok...@apache.org tinkerpop git commit: realized that DedupGlobalStep was doing a 'double dedup'. the barrier which is already dedup'd is added to the master traveral's dedup-step and then dedup'd again. I simple boolean flag added to determine if the master traversal's d Tue, 03 Jan, 18:31
ok...@apache.org tinkerpop git commit: minor nothing. Tue, 03 Jan, 18:51
spmalle...@apache.org [1/2] tinkerpop git commit: Mark one of the Peer Pressure tests as non-deterministic. Tue, 03 Jan, 18:59
spmalle...@apache.org   [2/2] tinkerpop git commit: Merge branch 'tp32' Tue, 03 Jan, 18:59
spmalle...@apache.org tinkerpop git commit: Mark one of the Peer Pressure tests as non-deterministic. Tue, 03 Jan, 18:59
ok...@apache.org tinkerpop git commit: bumped to Spark 2.0.2 from Spark 2.0.0. Easy tweak and test -- CTR. Tue, 03 Jan, 20:41
ok...@apache.org tinkerpop git commit: Added TinkerWorkerMemory which will aggregate local to the current thread before propagated Memory to TinkerMemory. This reduces synchronization issues due all threads contending to mutate the master memory. Wed, 04 Jan, 01:00
ok...@apache.org tinkerpop git commit: forgot to add TinkerWorkerMemory file. Wed, 04 Jan, 01:00
ok...@apache.org tinkerpop git commit: Added Serializer.cloneObject() which clones via serialization (helper method). TinkerGraphComputer now how a sound distributed Memory system where each worker/thread aggregates without concurrency locally and then, at the end of the Wed, 04 Jan, 11:06
ok...@apache.org tinkerpop git commit: Made is so MemoryComputeKey implements Cloneable. This is actually really important we have NOT been cloning the BiOperators of OrderGlobalStep and GroupStep. We have just been 'getting lucky' in that Spark and Giraph use Serializat Wed, 04 Jan, 11:55
ok...@apache.org tinkerpop git commit: updated CHANGELOG. Going to move on. Need example Gryo dataset from @dkuppitz to verify performance improvement of DedupGlobalStep on SparkGraphComputer. Wed, 04 Jan, 12:05
ok...@apache.org [01/50] [abbrv] tinkerpop git commit: Fixed minor bug in ByteBuffer gryo serializer. CTR [Forced Update!] Wed, 04 Jan, 13:58
ok...@apache.org   [02/50] [abbrv] tinkerpop git commit: Merge branch 'tp32' Wed, 04 Jan, 13:58
ok...@apache.org   [03/50] [abbrv] tinkerpop git commit: Fixed broken GryoMapper test CTR Wed, 04 Jan, 13:58
ok...@apache.org   [04/50] [abbrv] tinkerpop git commit: Merge branch 'tp32' Wed, 04 Jan, 13:58
ok...@apache.org   [05/50] [abbrv] tinkerpop git commit: Merge branch 'pr-519' into tp32 Wed, 04 Jan, 13:58
ok...@apache.org   [06/50] [abbrv] tinkerpop git commit: Update CHANGELOG CTR Wed, 04 Jan, 13:58
ok...@apache.org   [07/50] [abbrv] tinkerpop git commit: Merge branch 'tp32' Wed, 04 Jan, 13:58
ok...@apache.org   [08/50] [abbrv] tinkerpop git commit: TINKERPOP-1587 TinkerGraph serialization supports multiproperties Wed, 04 Jan, 13:58
ok...@apache.org   [09/50] [abbrv] tinkerpop git commit: Merge branch 'tp32' Wed, 04 Jan, 13:58
ok...@apache.org   [10/50] [abbrv] tinkerpop git commit: TINKERPOP-1587 Forgot to update the both TinkerGraph serializers CTR Wed, 04 Jan, 13:58
ok...@apache.org   [11/50] [abbrv] tinkerpop git commit: Merge branch 'tp32' Wed, 04 Jan, 13:58
ok...@apache.org   [12/50] [abbrv] tinkerpop git commit: TINKERGRAPH-1587 Forgot to do the v2 GraphSON for TinkerGraph Wed, 04 Jan, 13:58
ok...@apache.org   [13/50] [abbrv] tinkerpop git commit: Merge branch 'tp32' Wed, 04 Jan, 13:58
ok...@apache.org   [14/50] [abbrv] tinkerpop git commit: merged Spark 2.0.0 work. Massive undertaking that provided us performance improvements. Thanks @dalaro and @yucx. Wed, 04 Jan, 13:58
ok...@apache.org   [15/50] [abbrv] tinkerpop git commit: Mark one of the Peer Pressure tests as non-deterministic. Wed, 04 Jan, 13:58
ok...@apache.org   [16/50] [abbrv] tinkerpop git commit: Merge branch 'tp32' Wed, 04 Jan, 13:58
ok...@apache.org   [17/50] [abbrv] tinkerpop git commit: bumped to Spark 2.0.2 from Spark 2.0.0. Easy tweak and test -- CTR. Wed, 04 Jan, 13:58
ok...@apache.org   [18/50] [abbrv] tinkerpop git commit: more alignment between GraphActors and GraphComputer. GraphActors.partitioner().program().submit(). Unlike GraphComputer, there is no Graph.actors(). HOWEVER -- since GraphActors is Partition-centric, perhaps we do G Wed, 04 Jan, 13:58
ok...@apache.org   [19/50] [abbrv] tinkerpop git commit: commited to g.withProcessor(Processor.Description). Actors and Computer implement Processor.Description. Following the VertexProgramStrategy model, this makes it easy for language variant providers to support any arb Wed, 04 Jan, 13:58
ok...@apache.org   [20/50] [abbrv] tinkerpop git commit: lots of cleanup and organization of the interfaces. trying to line up the GraphActors interfaces as much as possible with GraphComputer interfaces. JavaDoc'in. Wed, 04 Jan, 13:58
ok...@apache.org   [21/50] [abbrv] tinkerpop git commit: created a new module called akka-gremlin. It will implement the actor/ package interfaces (yet to be defined in gremlin-core). Wed, 04 Jan, 13:58
ok...@apache.org   [22/50] [abbrv] tinkerpop git commit: created a new module called akka-gremlin. It will implement the actor/ package interfaces (yet to be defined in gremlin-core). Wed, 04 Jan, 13:58
ok...@apache.org   [23/50] [abbrv] tinkerpop git commit: we now have a full generalized process/actor interface system where akka-gremlin/ implements those interfaces. Next, we have ActorProgram with TraversalActorProgram exectuing a traversal. This is identical in form to Wed, 04 Jan, 13:58
ok...@apache.org   [24/50] [abbrv] tinkerpop git commit: we now have a full generalized process/actor interface system where akka-gremlin/ implements those interfaces. Next, we have ActorProgram with TraversalActorProgram exectuing a traversal. This is identical in form to Wed, 04 Jan, 13:58
ok...@apache.org   [25/50] [abbrv] tinkerpop git commit: started on the process.actor interfaces in gremlin-core. Really cool as the naming/model lines up nicely with process.computer interfaces. ActorStep and ActorStrategy are now generalized to work with Actors interface Wed, 04 Jan, 13:58
ok...@apache.org   [26/50] [abbrv] tinkerpop git commit: I have all the failing tests ignored in the AkkaActorsProvider. I know why they fail -- mainly around order()... once I solve that, done. Wed, 04 Jan, 13:58
ok...@apache.org   [27/50] [abbrv] tinkerpop git commit: okay. mailboxes are controlled by ActorProgram.getMessagePriorities(). Took me forever to figure out how to dynamically configure akka mailboxes. Wed, 04 Jan, 13:58
ok...@apache.org   [28/50] [abbrv] tinkerpop git commit: okay, all direct references to akka URIs are removed from gremlin-core. I have one more thing to do with Message priorities. After that, clean, Javadoc, etc. Going to take a break for a bit first. Wed, 04 Jan, 13:58
ok...@apache.org   [29/50] [abbrv] tinkerpop git commit: taking a lunch break --- added more JavaDoc and started honing in on how withProcessor() will generalize... sorta tricky. Wed, 04 Jan, 13:58
ok...@apache.org   [30/50] [abbrv] tinkerpop git commit: to hell and back and got nowhere. 2 hour code hole trying to remove GraphComputer semantics from Actor traversals..... had it all working up till group() not finalizing results. No idea why. Wed, 04 Jan, 13:58
ok...@apache.org   [31/50] [abbrv] tinkerpop git commit: split up start and terminate messages. Wed, 04 Jan, 13:58
ok...@apache.org   [32/50] [abbrv] tinkerpop git commit: OMG. That was a 3+ hour bug. The bug was not in Actors, but in GroupStep cloning.... So painful. Renamed Actors to GraphActors so its like GraphComputer. Renamed ActorStep to TraversalActorProgramStep so its like Tra Wed, 04 Jan, 13:58
ok...@apache.org   [33/50] [abbrv] tinkerpop git commit: came up with a clever idea for maintaining order in a distributed traversal. OrdereredTraverser is a wrapper around a Traverser where all methods are delegated to the internal traverser. However, OrderedTraverser has Wed, 04 Jan, 13:58
ok...@apache.org   [34/50] [abbrv] tinkerpop git commit: ahhh.. a really solid simplification using the Terminate token as the barrier synchronizer. Lots of other little random clean me ups. Things are looking brighter at close of business. Wed, 04 Jan, 13:58
ok...@apache.org   [35/50] [abbrv] tinkerpop git commit: added Pushing and Distributing which are currently the two constructs of GraphComputing. GraphComputing is now deprecated with its corresponding methods calling the respective Pushing/Distributing methods. Pushing me Wed, 04 Jan, 13:58
ok...@apache.org   [36/50] [abbrv] tinkerpop git commit: added StringFactory rules for GraphActors, Partitioner, and Partition. Realized someting profoundly sucky about DedupGlobalStep. Exposed more test cases to AkkaGraphActors. Wed, 04 Jan, 13:58
ok...@apache.org   [37/50] [abbrv] tinkerpop git commit: learned about preStart() and postStop() methods in Akka Actors. Lined those up with actor.terminate() and actor.setup(). JavaDoc here and there.... nada much. done for the night. Wed, 04 Jan, 13:58
ok...@apache.org   [38/50] [abbrv] tinkerpop git commit: Created AkkaGremlinPlugin so you can import akka-gremlin into GremlinConsole (and GremlinServer--not sure). The concept of an Actor Address now has to identifies -- the physical location of the actor and the unique ( Wed, 04 Jan, 13:58
ok...@apache.org   [39/50] [abbrv] tinkerpop git commit: So much. withProcessor(Processor). No more Compute. Process.submit(Graph) as we are now staging it so that every Processor (GraphComputer/GraphAgents) can work over any Graph. This will all be via Partitioner. withCo Wed, 04 Jan, 13:58
ok...@apache.org   [40/50] [abbrv] tinkerpop git commit: So much. withProcessor(Processor). No more Compute. Process.submit(Graph) as we are now staging it so that every Processor (GraphComputer/GraphAgents) can work over any Graph. This will all be via Partitioner. withCo Wed, 04 Jan, 13:58
ok...@apache.org   [41/50] [abbrv] tinkerpop git commit: added GraphActorsHelper which will configure a GraphActors via its fluent interface via a provided Configuration. Added a new GraphActorsTest that ensures worker counts are correct. Wed, 04 Jan, 13:58
ok...@apache.org   [42/50] [abbrv] tinkerpop git commit: We now have PartitionInputFormat which allows an Hadoop-based GraphComputer to pull data from any Graph implementation. PartitionInputSplit is basically a wrapper around Partition so that data access is data-local an Wed, 04 Jan, 13:59
ok...@apache.org   [43/50] [abbrv] tinkerpop git commit: small nothing. Wed, 04 Jan, 13:59
ok...@apache.org   [44/50] [abbrv] tinkerpop git commit: okay. so I created ProcessActorsSuite and our first actors specific test -- GraphActorsTest (currently just makes sure toString() is valid :). Really organizing things around Configuration... Just like Graphs, Comput Wed, 04 Jan, 13:59
ok...@apache.org   [45/50] [abbrv] tinkerpop git commit: got new GraphComputer.configuration() model working for SparkGraphComputer and GiraphGraphComputer. Wed, 04 Jan, 13:59
ok...@apache.org   [46/50] [abbrv] tinkerpop git commit: came up with a much cleaner GiraphGraphComputer usage around workers. Wed, 04 Jan, 13:59
ok...@apache.org   [47/50] [abbrv] tinkerpop git commit: added a GraphComputerTest that ensures that the GraphComputer configuration evolves as expected and that it does not alter the Graph configuration. Wed, 04 Jan, 13:59
ok...@apache.org   [48/50] [abbrv] tinkerpop git commit: Tweaks to SparkGraphComputer configuration settings. More GraphComputerTest things. Before the break, I want to have Configuration all stubbed out for GraphComputer and GraphActors and then this branch is simply a fu Wed, 04 Jan, 13:59
ok...@apache.org   [49/50] [abbrv] tinkerpop git commit: revert to master/ representation of GroupStep. TINKERPOP-1590 has the clone safe model. Wed, 04 Jan, 13:59
ok...@apache.org   [50/50] [abbrv] tinkerpop git commit: added graphNotSupported coverage to GraphComputerTest. Added JavaDocs here and there while I was waiting for the test suite to complete. Wed, 04 Jan, 13:59
ok...@apache.org [1/3] tinkerpop git commit: refactored GraphActors packaging -- its not actor/, but actors/. JavaDoc and various cleanups. Also, about to NOT serialize a traversal but instead use Bytecode. Next push will do this with TraveraslVertexProgram. Wed, 04 Jan, 15:01
ok...@apache.org   [2/3] tinkerpop git commit: refactored GraphActors packaging -- its not actor/, but actors/. JavaDoc and various cleanups. Also, about to NOT serialize a traversal but instead use Bytecode. Next push will do this with TraveraslVertexProgram. Wed, 04 Jan, 15:01
ok...@apache.org   [3/3] tinkerpop git commit: refactored GraphActors packaging -- its not actor/, but actors/. JavaDoc and various cleanups. Also, about to NOT serialize a traversal but instead use Bytecode. Next push will do this with TraveraslVertexProgram. Wed, 04 Jan, 15:01
spmalle...@apache.org [1/2] tinkerpop git commit: Fixed a minor problem in closing a sessioned client that was not initialized CTR Wed, 04 Jan, 15:01
spmalle...@apache.org   [2/2] tinkerpop git commit: Merge branch 'tp32' Wed, 04 Jan, 15:01
spmalle...@apache.org tinkerpop git commit: Fixed a minor problem in closing a sessioned client that was not initialized CTR Wed, 04 Jan, 15:01
ok...@apache.org tinkerpop git commit: discovering various synchronization bottlenecks in TinkerGraphComputer. Also, realized some dumb things I was doing in TraversalVertexProgram. Its crazy, for this benchmark that @dkuppitz and i have, if I don't touch vertex.properti Wed, 04 Jan, 17:32
ok...@apache.org tinkerpop git commit: CHAGELOG updated. Lunch time. Wed, 04 Jan, 17:48
ok...@apache.org tinkerpop git commit: no more SynchronizedIterator for TinkerGraphComputer. Each worker/thread has their own Iterator<Vertex> partition. In TinkerPop 3.3.0 (with Partitioner) this will be replaced (easily). Wed, 04 Jan, 19:39
ok...@apache.org tinkerpop git commit: now that MemoryComputeKeys are cloneable, they are cloned accordignly in TraversalVertexProgram.clone(). Wed, 04 Jan, 19:50
ok...@apache.org tinkerpop git commit: added the concept of a master barrier to DedupGlobalStep to speed up the addition of worker barriers into the master traversal. A slight performance increase. Wed, 04 Jan, 20:13
ok...@apache.org tinkerpop git commit: added the @dkuppitz example to the AkkaGraphActors test/ package for playing and benchmarking. Wed, 04 Jan, 22:10
ok...@apache.org tinkerpop git commit: smarter distribution of initial GraphStep traversers. Wed, 04 Jan, 22:18
spmalle...@apache.org tinkerpop git commit: TINKERPOP-1589 Re-introduced CloseableIterator Thu, 05 Jan, 11:09
spmalle...@apache.org tinkerpop git commit: TINKERPOP-1589 Made some adjustments to Traversal.close() Thu, 05 Jan, 15:01
ok...@apache.org tinkerpop git commit: added Terminal Steps section to the-traversal.asciidoc docs. Thu, 05 Jan, 15:33
spmalle...@apache.org [1/2] tinkerpop git commit: Removed use of deprecated ScriptEngines class. CTR Thu, 05 Jan, 16:30
spmalle...@apache.org   [2/2] tinkerpop git commit: Merge branch 'tp32' Thu, 05 Jan, 16:30
spmalle...@apache.org tinkerpop git commit: Removed use of deprecated ScriptEngines class. CTR Thu, 05 Jan, 16:30
ok...@apache.org [1/2] tinkerpop git commit: added Terminal Steps section to the-traversal.asciidoc docs. Thu, 05 Jan, 16:49
ok...@apache.org   [2/2] tinkerpop git commit: Merge branch 'tp32' of https://git-wip-us.apache.org/repos/asf/tinkerpop into tp32 Thu, 05 Jan, 16:49
ok...@apache.org [1/3] tinkerpop git commit: added Terminal Steps section to the-traversal.asciidoc docs. Thu, 05 Jan, 16:49
ok...@apache.org   [2/3] tinkerpop git commit: Merge branch 'tp32' of https://git-wip-us.apache.org/repos/asf/tinkerpop into tp32 Thu, 05 Jan, 16:49
ok...@apache.org   [3/3] tinkerpop git commit: Merge branch 'tp32' Thu, 05 Jan, 16:49
ok...@apache.org tinkerpop git commit: more minor optimizations to DedupGlobalStep. Thu, 05 Jan, 17:34
ok...@apache.org tinkerpop git commit: have DedupGlobalStep as optimized as I can get it. I think BloomFilters are the next thing. Also, detachment factory stuff will help reduce barrier sizes. Found a bug in SparkInterceptorStrategyTest. Fixed. Thu, 05 Jan, 20:29
ok...@apache.org tinkerpop git commit: removed the toy file and updated CHANGELOG. Thu, 05 Jan, 23:59
ok...@apache.org [01/20] tinkerpop git commit: Mark one of the Peer Pressure tests as non-deterministic. [Forced Update!] Fri, 06 Jan, 00:00
ok...@apache.org   [02/20] tinkerpop git commit: Fixed a minor problem in closing a sessioned client that was not initialized CTR Fri, 06 Jan, 00:00
ok...@apache.org   [03/20] tinkerpop git commit: added Terminal Steps section to the-traversal.asciidoc docs. Fri, 06 Jan, 00:00
ok...@apache.org   [04/20] tinkerpop git commit: Removed use of deprecated ScriptEngines class. CTR Fri, 06 Jan, 00:00
ok...@apache.org   [05/20] tinkerpop git commit: Merge branch 'tp32' of https://git-wip-us.apache.org/repos/asf/tinkerpop into tp32 Fri, 06 Jan, 00:00
ok...@apache.org   [06/20] tinkerpop git commit: forgot to add TinkerWorkerMemory file. Fri, 06 Jan, 00:00
ok...@apache.org   [07/20] tinkerpop git commit: minor nothing. Fri, 06 Jan, 00:00
ok...@apache.org   [08/20] tinkerpop git commit: realized that DedupGlobalStep was doing a 'double dedup'. the barrier which is already dedup'd is added to the master traveral's dedup-step and then dedup'd again. I simple boolean flag added to determine if the master trave Fri, 06 Jan, 00:00
ok...@apache.org   [09/20] tinkerpop git commit: Added TinkerWorkerMemory which will aggregate local to the current thread before propagated Memory to TinkerMemory. This reduces synchronization issues due all threads contending to mutate the master memory. Fri, 06 Jan, 00:00
ok...@apache.org   [10/20] tinkerpop git commit: Made is so MemoryComputeKey implements Cloneable. This is actually really important we have NOT been cloning the BiOperators of OrderGlobalStep and GroupStep. We have just been 'getting lucky' in that Spark and Giraph use Se Fri, 06 Jan, 00:00
ok...@apache.org   [11/20] tinkerpop git commit: Added Serializer.cloneObject() which clones via serialization (helper method). TinkerGraphComputer now how a sound distributed Memory system where each worker/thread aggregates without concurrency locally and then, at the en Fri, 06 Jan, 00:00
ok...@apache.org   [12/20] tinkerpop git commit: updated CHANGELOG. Going to move on. Need example Gryo dataset from @dkuppitz to verify performance improvement of DedupGlobalStep on SparkGraphComputer. Fri, 06 Jan, 00:00
ok...@apache.org   [13/20] tinkerpop git commit: discovering various synchronization bottlenecks in TinkerGraphComputer. Also, realized some dumb things I was doing in TraversalVertexProgram. Its crazy, for this benchmark that @dkuppitz and i have, if I don't touch vertex. Fri, 06 Jan, 00:00
ok...@apache.org   [14/20] tinkerpop git commit: CHAGELOG updated. Lunch time. Fri, 06 Jan, 00:00
ok...@apache.org   [15/20] tinkerpop git commit: removed the toy file and updated CHANGELOG. Fri, 06 Jan, 00:00
ok...@apache.org   [16/20] tinkerpop git commit: more minor optimizations to DedupGlobalStep. Fri, 06 Jan, 00:00
ok...@apache.org   [17/20] tinkerpop git commit: added the concept of a master barrier to DedupGlobalStep to speed up the addition of worker barriers into the master traversal. A slight performance increase. Fri, 06 Jan, 00:00
ok...@apache.org   [18/20] tinkerpop git commit: no more SynchronizedIterator for TinkerGraphComputer. Each worker/thread has their own Iterator<Vertex> partition. In TinkerPop 3.3.0 (with Partitioner) this will be replaced (easily). Fri, 06 Jan, 00:00
ok...@apache.org   [19/20] tinkerpop git commit: now that MemoryComputeKeys are cloneable, they are cloned accordignly in TraversalVertexProgram.clone(). Fri, 06 Jan, 00:00
ok...@apache.org   [20/20] tinkerpop git commit: have DedupGlobalStep as optimized as I can get it. I think BloomFilters are the next thing. Also, detachment factory stuff will help reduce barrier sizes. Found a bug in SparkInterceptorStrategyTest. Fixed. Fri, 06 Jan, 00:00
spmalle...@apache.org tinkerpop git commit: Added more cycle detection and traversal induced value recipes. Fri, 06 Jan, 13:58
spmalle...@apache.org [1/2] tinkerpop git commit: Added more content to traversal induced value recipe Fri, 06 Jan, 18:37
spmalle...@apache.org   [2/2] tinkerpop git commit: Added an additional example to project() step Fri, 06 Jan, 18:37
spmalle...@apache.org [01/44] tinkerpop git commit: TINKERPOP-1130 Structured the IO compatibility tests Fri, 06 Jan, 19:42
spmalle...@apache.org   [02/44] tinkerpop git commit: TINKERPOP-1130 Structured the IO compatibility tests Fri, 06 Jan, 19:42
spmalle...@apache.org   [03/44] tinkerpop git commit: TINKERPOP-1130 Structured the IO compatibility tests Fri, 06 Jan, 19:42
spmalle...@apache.org   [04/44] tinkerpop git commit: TINKERPOP-1130 Structured the IO compatibility tests Fri, 06 Jan, 19:42
spmalle...@apache.org   [05/44] tinkerpop git commit: TINKERPOP-1130 Structured the IO compatibility tests Fri, 06 Jan, 19:42
spmalle...@apache.org   [06/44] tinkerpop git commit: TINKERPOP-1130 Structured the IO compatibility tests Fri, 06 Jan, 19:42
spmalle...@apache.org   [07/44] tinkerpop git commit: TINKERPOP-1130 Structured the IO compatibility tests Fri, 06 Jan, 19:42
spmalle...@apache.org   [08/44] tinkerpop git commit: TINKERPOP-1130 Structured the IO compatibility tests Fri, 06 Jan, 19:42
spmalle...@apache.org   [09/44] tinkerpop git commit: TINKERPOP-1130 Enabled testing of int/double for GraphSON Fri, 06 Jan, 19:42
spmalle...@apache.org   [10/44] tinkerpop git commit: TINKERPOP-1130 Improved asserts on Graph elements. Fri, 06 Jan, 19:42
spmalle...@apache.org   [11/44] tinkerpop git commit: TINKERPOP-1130 Completed tests for typed IO Fri, 06 Jan, 19:42
spmalle...@apache.org   [12/44] tinkerpop git commit: TINKERPOP-1130 Implemented many additional IO tests. Fri, 06 Jan, 19:42
spmalle...@apache.org   [13/44] tinkerpop git commit: TINKERPOP-1130 Implemented many additional IO tests. Fri, 06 Jan, 19:42
spmalle...@apache.org   [14/44] tinkerpop git commit: TINKERPOP-1130 Made the test data for metrics static. Fri, 06 Jan, 19:42
spmalle...@apache.org   [15/44] tinkerpop git commit: TINKERPOP-1130 Get the basics of Gryo 3.0 in place. Fri, 06 Jan, 19:42
spmalle...@apache.org   [16/44] tinkerpop git commit: TINKERPOP-1130 Get the basics of Gryo 3.0 in place. Fri, 06 Jan, 19:42
spmalle...@apache.org   [17/44] tinkerpop git commit: TINKERPOP-1130 Add gremlin-test back as compile scope. Fri, 06 Jan, 19:42
spmalle...@apache.org   [18/44] tinkerpop git commit: TINKERPOP-1130 Changed scope of gremlin-test to "test" Fri, 06 Jan, 19:42
spmalle...@apache.org   [19/44] tinkerpop git commit: TINKERPOP-1130 Added more asserts for Element related tests Fri, 06 Jan, 19:42
spmalle...@apache.org   [20/44] tinkerpop git commit: TINKERPOP-1130 Fixed ByteBuffer compatibility with Gryo. Fri, 06 Jan, 19:42
spmalle...@apache.org   [21/44] tinkerpop git commit: TINKERPOP-1130 Added test support for ConjunctiveP in Gryo Fri, 06 Jan, 19:42
spmalle...@apache.org   [22/44] tinkerpop git commit: TINKERPOP-1130 Enabled GraphSON serialization tests for enums Fri, 06 Jan, 19:42
spmalle...@apache.org   [23/44] tinkerpop git commit: TINKERPOP-1130 Add 3.2.4 data files for gremlin-io-test Fri, 06 Jan, 19:42
spmalle...@apache.org   [24/44] tinkerpop git commit: TINKERPOP-1130 Add 3.2.4 data files for gremlin-io-test Fri, 06 Jan, 19:42
spmalle...@apache.org   [25/44] tinkerpop git commit: TINKERPOP-1130 Add 3.2.4 data files for gremlin-io-test Fri, 06 Jan, 19:42
spmalle...@apache.org   [26/44] tinkerpop git commit: TINKERPOP-1130 Add 3.2.4 data files for gremlin-io-test Fri, 06 Jan, 19:42
spmalle...@apache.org   [27/44] tinkerpop git commit: TINKERPOP-1130 Added TinkerGraph support in gremlin-io-test Fri, 06 Jan, 19:42
spmalle...@apache.org   [28/44] tinkerpop git commit: TINKERPOP-1130 Enable more tests on gryo 1.0 and 3.3.0. Fri, 06 Jan, 19:42
spmalle...@apache.org   [29/44] tinkerpop git commit: TINKERPOP-1130 Added "incompatibility notes" Fri, 06 Jan, 19:42
spmalle...@apache.org   [30/44] tinkerpop git commit: TINKERPOP-1130 Revised the model for Tree Fri, 06 Jan, 19:42
spmalle...@apache.org   [31/44] tinkerpop git commit: TINKERPOP-1130 Testing for Path untyped GraphSON Fri, 06 Jan, 19:42
spmalle...@apache.org   [32/44] tinkerpop git commit: TINKERPOP-1130 Finished tests for untyped structure elements. Fri, 06 Jan, 19:42
spmalle...@apache.org   [33/44] tinkerpop git commit: TINKERPOP-1130 Regenerated IO docs for GraphSON Fri, 06 Jan, 19:42
spmalle...@apache.org   [34/44] tinkerpop git commit: TINKERPOP-1130 Add Compatiblities helper class Fri, 06 Jan, 19:42
spmalle...@apache.org   [35/44] tinkerpop git commit: TINKERPOP-1130 Cleaned up compatibility definitions Fri, 06 Jan, 19:42
spmalle...@apache.org   [36/44] tinkerpop git commit: TINKERPOP-1130 Added Request/ResponseMessage incompatibilty reasons. Fri, 06 Jan, 19:42
spmalle...@apache.org   [37/44] tinkerpop git commit: TINKERPOP-1130 Removed support for testing "time" with untyped GraphSON Fri, 06 Jan, 19:42
spmalle...@apache.org   [38/44] tinkerpop git commit: TINKERPOP-1130 Completed GraphSON tests for Request/ResponseMessage Fri, 06 Jan, 19:42
spmalle...@apache.org   [39/44] tinkerpop git commit: TINKERPOP-1130 Added back graphson generation script for 3.2.4 Fri, 06 Jan, 19:42
spmalle...@apache.org   [40/44] tinkerpop git commit: TINKERPOP-1130 Tests for edge untyped graphson Fri, 06 Jan, 19:42
spmalle...@apache.org   [41/44] tinkerpop git commit: TINKERPOP-1130 Move common compatibility filters to Compatibilities Fri, 06 Jan, 19:42
spmalle...@apache.org   [42/44] tinkerpop git commit: TINKERPOP-1130 Removed incompatibility notes concept. Fri, 06 Jan, 19:42
spmalle...@apache.org   [43/44] tinkerpop git commit: TINKERPOP-1130 Added configuration filter for Compatibilities Fri, 06 Jan, 19:42
spmalle...@apache.org   [44/44] tinkerpop git commit: Merge remote-tracking branch 'origin/TINKERPOP-1130' Fri, 06 Jan, 19:42
ok...@apache.org tinkerpop git commit: found a fixed a bug in RepeatUnrollStragegy. Global stateful steps like DedupGlobalStep can not be unrolled else you have split the global state amongst times(x) local steps. Added a test case to DedupGlobalStep g.V().repeat(dedup( Fri, 06 Jan, 20:02
dkupp...@apache.org svn commit: r1777880 - in /tinkerpop/site: docs/3.2.4-SNAPSHOT/dev/developer/ docs/3.2.4-SNAPSHOT/dev/provider/ docs/3.2.4-SNAPSHOT/images/ docs/3.2.4-SNAPSHOT/recipes/ docs/3.2.4-SNAPSHOT/reference/ docs/3.2.4-SNAPSHOT/tutorials/gremlin-language-varia... Sun, 08 Jan, 12:19
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · Next »Thread · Author · Date
Box list
Nov 2020190
Oct 2020306
Sep 2020227
Aug 2020159
Jul 202074
Jun 2020214
May 2020176
Apr 2020266
Mar 2020293
Feb 2020257
Jan 2020304
Dec 2019299
Nov 2019288
Oct 2019277
Sep 2019431
Aug 2019281
Jul 2019467
Jun 2019574
May 2019342
Apr 2019240
Mar 2019448
Feb 2019282
Jan 2019487
Dec 2018433
Nov 2018459
Oct 2018943
Sep 2018516
Aug 2018960
Jul 2018605
Jun 2018845
May 2018866
Apr 20181008
Mar 20181185
Feb 2018379
Jan 2018723
Dec 2017333
Nov 2017779
Oct 2017473
Sep 2017884
Aug 2017494
Jul 2017992
Jun 20171082
May 2017660
Apr 2017337
Mar 2017729
Feb 20171052
Jan 20171626
Dec 2016869
Nov 20161023
Oct 20161010
Sep 2016910
Aug 2016598
Jul 2016537
Jun 2016787
May 2016660
Apr 2016422
Mar 20161169
Feb 2016852
Jan 2016316
Dec 2015523
Nov 2015485
Oct 2015838
Sep 2015535
Aug 2015322
Jul 2015480
Jun 2015758
May 2015909
Apr 2015954
Mar 2015613
Feb 2015351
Jan 20159