tinkerpop-commits mailing list archives: January 2017

Site index · List index
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · Next »Thread · Author · Date
ok...@apache.org [01/24] tinkerpop git commit: if the System.getProperty() has a shim-service set, then it is also set as a DRIVER_JAVA_OPTIONS and an EXECUTOR_JAVA_OPTIONS in SparkGraphComputer (this is necessary for Spark 2.0). Also, some is.testing class registrations Tue, 03 Jan, 14:43
ok...@apache.org [02/24] tinkerpop git commit: TINKERPOP-1389 Support Spark 2.0 Tue, 03 Jan, 14:43
ok...@apache.org [03/24] tinkerpop git commit: @dalaro provided an update to KryoShimServiceLoader via a gist as the LOG message was not so clear. Tue, 03 Jan, 14:43
ok...@apache.org [04/24] tinkerpop git commit: had to go back down to Hadoop 2.7.2 because Hadoop 2.7.3 changed a method signature that GiraphJob calls and thus, Giraph fails. Dar. Cleaned up pom.xmls a bit and updated CHANGELOG. This branch is ready to be tested on the Tue, 03 Jan, 14:43
ok...@apache.org [05/24] tinkerpop git commit: jesus. that was a depedency hell like only spark can provide. got SparkServer working with GremlinConsole and HDFS. Phew... Also, bumped to Hadoop 2.7.3 (from 2.7.2). Tue, 03 Jan, 14:43
ok...@apache.org [06/24] tinkerpop git commit: GryoSerializer uses HadoopPools so that gryo pools are not constantly produced (object reused stylie). This have increased the performance of GryoSerializer based jobs to that of the 3.2.x line prior to bumping to Spark 2.0. Tue, 03 Jan, 14:43
ok...@apache.org [07/24] tinkerpop git commit: minor nothing to GiraphGraphComputer. Tue, 03 Jan, 14:43
ok...@apache.org [08/24] tinkerpop git commit: UnshadedKryoShimService is now the default for SparkGraphComputer. Users no longer have to System.setProperty() as its all handled in the SparkGraphComputer constructor. I would really like to get rid of the 'service model' Tue, 03 Jan, 14:43
ok...@apache.org [09/24] tinkerpop git commit: added SystemUtil to gremlin-core which is able to generate Configurations from System.properties. Useful in Hadoop GraphComputer settings where JVMs can have IO configuration information in them. HadoopPools will now try and Tue, 03 Jan, 14:43
ok...@apache.org [10/24] tinkerpop git commit: Decoupled GryoRecordReader/Writer from KryoShimService. The shim service should ONLY be for inter-process communication -- not input/output formats. cc/ @dalaro Tue, 03 Jan, 14:43
ok...@apache.org [11/24] tinkerpop git commit: Avoid starting VP worker iterations that never end Tue, 03 Jan, 14:43
ok...@apache.org [12/24] tinkerpop git commit: Really simplified UnshadedKryoShimService and IoRegistryAwareKryoSerializer. Also, introduced a synchronization point in KryoServiceLoader.applyConfiguration() as I believe that multiple threads are creating a service over a Tue, 03 Jan, 14:43
ok...@apache.org [13/24] tinkerpop git commit: using tinkerpop as the prefix for System property configurations. Tweaked the KryoShimServiceLoader's logging information so its easier to see whats going on --- doing cluster testing. Tue, 03 Jan, 14:43
ok...@apache.org [14/24] tinkerpop git commit: lots of good stuff here -- finally have testing of IORegistry in SparkGraphComputer. Have ToyPoint and TestIoRegistry. Realized a bunch of stupid .flush() calls in the GryoSerializer serializers (Spark)... perhaps that is wh Tue, 03 Jan, 14:44
ok...@apache.org [15/24] tinkerpop git commit: Added AbstractIoRegistryCheck that verifies the IoRegistry of test-types (ToyPoint and ToyTriangle) work for OLTP, OLAP, and Storage streaming on all Hadoop-based graphs (Giraph/Spark). Currently, it only checks Gryo regitra Tue, 03 Jan, 14:44
ok...@apache.org [16/24] tinkerpop git commit: dah. sorry. had some work I started doing before the previous commit. reverting. Tue, 03 Jan, 14:44
ok...@apache.org [17/24] tinkerpop git commit: KryoShimServices now implement .close() so they can relinquish resources. KryoShimServiceLoader also implements close() and will close any static shim service it maintains. On a force reload, any existing KryoShimService is Tue, 03 Jan, 14:44
ok...@apache.org [18/24] tinkerpop git commit: weird necessity. will figure out cause later. Tue, 03 Jan, 14:44
ok...@apache.org [19/24] tinkerpop git commit: okay. so I found a bug that has to do with joins() in Spark and IoRegistry.... I thought this whole time it was from me -- but then I realized that I added a .out() to the test. I reverted to an older version of the branch a Tue, 03 Jan, 14:44
ok...@apache.org [20/24] tinkerpop git commit: Limit JVM system props passed around in Spark jobs Tue, 03 Jan, 14:44
ok...@apache.org [21/24] tinkerpop git commit: No more IoAwareSerializer -- it doens't work in Spark 2.0's serialization model. GryoRegistrar is now responsible for handling IoRegistry registration. Much simpler. Finally, everything is passing -- both GryoSerializer and Tue, 03 Jan, 14:44
ok...@apache.org [22/24] tinkerpop git commit: tweaks to IoRegistryHelper now that instance() is the default instead of getInstance(). Minor tweaks here and there otheriwse. Rebased with master/. Tue, 03 Jan, 14:44
ok...@apache.org [23/24] tinkerpop git commit: fixed a bug in the CHANGELOG and added a few more things. Tue, 03 Jan, 14:44
ok...@apache.org [24/24] tinkerpop git commit: merged Spark 2.0.0 work. Massive undertaking that provided us performance improvements. Thanks @dalaro and @yucx. Tue, 03 Jan, 14:44
spmalle...@apache.org tinkerpop git commit: TINKERPOP-1130 Removed incompatibility notes concept. Tue, 03 Jan, 15:07
spmalle...@apache.org [01/50] [abbrv] tinkerpop git commit: Really simplified UnshadedKryoShimService and IoRegistryAwareKryoSerializer. Also, introduced a synchronization point in KryoServiceLoader.applyConfiguration() as I believe that multiple threads are creating a servic [Forced Update!] Tue, 03 Jan, 15:44
spmalle...@apache.org [02/50] [abbrv] tinkerpop git commit: Limit JVM system props passed around in Spark jobs Tue, 03 Jan, 15:44
spmalle...@apache.org [03/50] [abbrv] tinkerpop git commit: No more IoAwareSerializer -- it doens't work in Spark 2.0's serialization model. GryoRegistrar is now responsible for handling IoRegistry registration. Much simpler. Finally, everything is passing -- both GryoSeriali Tue, 03 Jan, 15:44
spmalle...@apache.org [04/50] [abbrv] tinkerpop git commit: okay. so I found a bug that has to do with joins() in Spark and IoRegistry.... I thought this whole time it was from me -- but then I realized that I added a .out() to the test. I reverted to an older version of the Tue, 03 Jan, 15:44
spmalle...@apache.org [05/50] [abbrv] tinkerpop git commit: tweaks to IoRegistryHelper now that instance() is the default instead of getInstance(). Minor tweaks here and there otheriwse. Rebased with master/. Tue, 03 Jan, 15:44
spmalle...@apache.org [06/50] [abbrv] tinkerpop git commit: fixed a bug in the CHANGELOG and added a few more things. Tue, 03 Jan, 15:44
spmalle...@apache.org [07/50] [abbrv] tinkerpop git commit: merged Spark 2.0.0 work. Massive undertaking that provided us performance improvements. Thanks @dalaro and @yucx. Tue, 03 Jan, 15:44
spmalle...@apache.org [08/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Structured the IO compatibility tests Tue, 03 Jan, 15:44
spmalle...@apache.org [09/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Structured the IO compatibility tests Tue, 03 Jan, 15:44
spmalle...@apache.org [10/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Structured the IO compatibility tests Tue, 03 Jan, 15:44
spmalle...@apache.org [11/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Structured the IO compatibility tests Tue, 03 Jan, 15:44
spmalle...@apache.org [12/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Structured the IO compatibility tests Tue, 03 Jan, 15:44
spmalle...@apache.org [13/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Structured the IO compatibility tests Tue, 03 Jan, 15:44
spmalle...@apache.org [14/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Structured the IO compatibility tests Tue, 03 Jan, 15:44
spmalle...@apache.org [15/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Structured the IO compatibility tests Tue, 03 Jan, 15:44
spmalle...@apache.org [16/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Get the basics of Gryo 3.0 in place. Tue, 03 Jan, 15:44
spmalle...@apache.org [17/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Get the basics of Gryo 3.0 in place. Tue, 03 Jan, 15:44
spmalle...@apache.org [18/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Made the test data for metrics static. Tue, 03 Jan, 15:44
spmalle...@apache.org [19/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Implemented many additional IO tests. Tue, 03 Jan, 15:44
spmalle...@apache.org [20/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Implemented many additional IO tests. Tue, 03 Jan, 15:44
spmalle...@apache.org [21/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Completed tests for typed IO Tue, 03 Jan, 15:44
spmalle...@apache.org [22/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Changed scope of gremlin-test to "test" Tue, 03 Jan, 15:44
spmalle...@apache.org [23/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Improved asserts on Graph elements. Tue, 03 Jan, 15:44
spmalle...@apache.org [24/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Added more asserts for Element related tests Tue, 03 Jan, 15:44
spmalle...@apache.org [25/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Add gremlin-test back as compile scope. Tue, 03 Jan, 15:44
spmalle...@apache.org [26/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Enabled testing of int/double for GraphSON Tue, 03 Jan, 15:44
spmalle...@apache.org [27/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Enabled GraphSON serialization tests for enums Tue, 03 Jan, 15:44
spmalle...@apache.org [28/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Add 3.2.4 data files for gremlin-io-test Tue, 03 Jan, 15:44
spmalle...@apache.org [29/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Add 3.2.4 data files for gremlin-io-test Tue, 03 Jan, 15:44
spmalle...@apache.org [30/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Add 3.2.4 data files for gremlin-io-test Tue, 03 Jan, 15:44
spmalle...@apache.org [31/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Add 3.2.4 data files for gremlin-io-test Tue, 03 Jan, 15:44
spmalle...@apache.org [32/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Added test support for ConjunctiveP in Gryo Tue, 03 Jan, 15:44
spmalle...@apache.org [33/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Fixed ByteBuffer compatibility with Gryo. Tue, 03 Jan, 15:44
spmalle...@apache.org [34/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Enable more tests on gryo 1.0 and 3.3.0. Tue, 03 Jan, 15:44
spmalle...@apache.org [35/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Added TinkerGraph support in gremlin-io-test Tue, 03 Jan, 15:44
spmalle...@apache.org [36/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Added "incompatibility notes" Tue, 03 Jan, 15:44
spmalle...@apache.org [37/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Tests for edge untyped graphson Tue, 03 Jan, 15:44
spmalle...@apache.org [38/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Add Compatiblities helper class Tue, 03 Jan, 15:44
spmalle...@apache.org [39/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Regenerated IO docs for GraphSON Tue, 03 Jan, 15:44
spmalle...@apache.org [40/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Revised the model for Tree Tue, 03 Jan, 15:44
spmalle...@apache.org [41/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Added Request/ResponseMessage incompatibilty reasons. Tue, 03 Jan, 15:44
spmalle...@apache.org [42/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Testing for Path untyped GraphSON Tue, 03 Jan, 15:44
spmalle...@apache.org [43/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Added back graphson generation script for 3.2.4 Tue, 03 Jan, 15:44
spmalle...@apache.org [44/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Finished tests for untyped structure elements. Tue, 03 Jan, 15:44
spmalle...@apache.org [45/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Cleaned up compatibility definitions Tue, 03 Jan, 15:44
spmalle...@apache.org [46/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Removed incompatibility notes concept. Tue, 03 Jan, 15:44
spmalle...@apache.org [47/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Completed GraphSON tests for Request/ResponseMessage Tue, 03 Jan, 15:44
spmalle...@apache.org [48/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Move common compatibility filters to Compatibilities Tue, 03 Jan, 15:44
spmalle...@apache.org [49/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Added configuration filter for Compatibilities Tue, 03 Jan, 15:44
spmalle...@apache.org [50/50] [abbrv] tinkerpop git commit: TINKERPOP-1130 Removed support for testing "time" with untyped GraphSON Tue, 03 Jan, 15:44
ok...@apache.org tinkerpop git commit: realized that DedupGlobalStep was doing a 'double dedup'. the barrier which is already dedup'd is added to the master traveral's dedup-step and then dedup'd again. I simple boolean flag added to determine if the master traversal's d Tue, 03 Jan, 18:31
ok...@apache.org tinkerpop git commit: minor nothing. Tue, 03 Jan, 18:51
spmalle...@apache.org [1/2] tinkerpop git commit: Mark one of the Peer Pressure tests as non-deterministic. Tue, 03 Jan, 18:59
spmalle...@apache.org [2/2] tinkerpop git commit: Merge branch 'tp32' Tue, 03 Jan, 18:59
spmalle...@apache.org tinkerpop git commit: Mark one of the Peer Pressure tests as non-deterministic. Tue, 03 Jan, 18:59
ok...@apache.org tinkerpop git commit: bumped to Spark 2.0.2 from Spark 2.0.0. Easy tweak and test -- CTR. Tue, 03 Jan, 20:41
ok...@apache.org tinkerpop git commit: Added TinkerWorkerMemory which will aggregate local to the current thread before propagated Memory to TinkerMemory. This reduces synchronization issues due all threads contending to mutate the master memory. Wed, 04 Jan, 01:00
ok...@apache.org tinkerpop git commit: forgot to add TinkerWorkerMemory file. Wed, 04 Jan, 01:00
ok...@apache.org tinkerpop git commit: Added Serializer.cloneObject() which clones via serialization (helper method). TinkerGraphComputer now how a sound distributed Memory system where each worker/thread aggregates without concurrency locally and then, at the end of the Wed, 04 Jan, 11:06
ok...@apache.org tinkerpop git commit: Made is so MemoryComputeKey implements Cloneable. This is actually really important we have NOT been cloning the BiOperators of OrderGlobalStep and GroupStep. We have just been 'getting lucky' in that Spark and Giraph use Serializat Wed, 04 Jan, 11:55
ok...@apache.org tinkerpop git commit: updated CHANGELOG. Going to move on. Need example Gryo dataset from @dkuppitz to verify performance improvement of DedupGlobalStep on SparkGraphComputer. Wed, 04 Jan, 12:05
ok...@apache.org [01/50] [abbrv] tinkerpop git commit: Fixed minor bug in ByteBuffer gryo serializer. CTR [Forced Update!] Wed, 04 Jan, 13:58
ok...@apache.org [02/50] [abbrv] tinkerpop git commit: Merge branch 'tp32' Wed, 04 Jan, 13:58
ok...@apache.org [03/50] [abbrv] tinkerpop git commit: Fixed broken GryoMapper test CTR Wed, 04 Jan, 13:58
ok...@apache.org [04/50] [abbrv] tinkerpop git commit: Merge branch 'tp32' Wed, 04 Jan, 13:58
ok...@apache.org [05/50] [abbrv] tinkerpop git commit: Merge branch 'pr-519' into tp32 Wed, 04 Jan, 13:58
ok...@apache.org [06/50] [abbrv] tinkerpop git commit: Update CHANGELOG CTR Wed, 04 Jan, 13:58
ok...@apache.org [07/50] [abbrv] tinkerpop git commit: Merge branch 'tp32' Wed, 04 Jan, 13:58
ok...@apache.org [08/50] [abbrv] tinkerpop git commit: TINKERPOP-1587 TinkerGraph serialization supports multiproperties Wed, 04 Jan, 13:58
ok...@apache.org [09/50] [abbrv] tinkerpop git commit: Merge branch 'tp32' Wed, 04 Jan, 13:58
ok...@apache.org [10/50] [abbrv] tinkerpop git commit: TINKERPOP-1587 Forgot to update the both TinkerGraph serializers CTR Wed, 04 Jan, 13:58
ok...@apache.org [11/50] [abbrv] tinkerpop git commit: Merge branch 'tp32' Wed, 04 Jan, 13:58
ok...@apache.org [12/50] [abbrv] tinkerpop git commit: TINKERGRAPH-1587 Forgot to do the v2 GraphSON for TinkerGraph Wed, 04 Jan, 13:58
ok...@apache.org [13/50] [abbrv] tinkerpop git commit: Merge branch 'tp32' Wed, 04 Jan, 13:58
ok...@apache.org [14/50] [abbrv] tinkerpop git commit: merged Spark 2.0.0 work. Massive undertaking that provided us performance improvements. Thanks @dalaro and @yucx. Wed, 04 Jan, 13:58
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · Next »Thread · Author · Date
Box list
Jan 2019346
Dec 2018433
Nov 2018459
Oct 2018943
Sep 2018516
Aug 2018960
Jul 2018605
Jun 2018845
May 2018866
Apr 20181008
Mar 20181185
Feb 2018379
Jan 2018723
Dec 2017333
Nov 2017779
Oct 2017473
Sep 2017884
Aug 2017494
Jul 2017992
Jun 20171082
May 2017660
Apr 2017337
Mar 2017729
Feb 20171052
Jan 20171626
Dec 2016869
Nov 20161023
Oct 20161010
Sep 2016910
Aug 2016598
Jul 2016537
Jun 2016787
May 2016660
Apr 2016422
Mar 20161169
Feb 2016852
Jan 2016316
Dec 2015523
Nov 2015485
Oct 2015838
Sep 2015535
Aug 2015322
Jul 2015480
Jun 2015758
May 2015909
Apr 2015954
Mar 2015613
Feb 2015351
Jan 20159