From commits-return-125589-archive-asf-public=cust-asf.ponee.io@ignite.apache.org Fri Dec 13 13:03:48 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id AA1B018064E for ; Fri, 13 Dec 2019 14:03:47 +0100 (CET) Received: (qmail 21213 invoked by uid 500); 13 Dec 2019 13:03:47 -0000 Mailing-List: contact commits-help@ignite.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@ignite.apache.org Delivered-To: mailing list commits@ignite.apache.org Received: (qmail 21201 invoked by uid 99); 13 Dec 2019 13:03:47 -0000 Received: from ec2-52-202-80-70.compute-1.amazonaws.com (HELO gitbox.apache.org) (52.202.80.70) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 13 Dec 2019 13:03:47 +0000 Received: by gitbox.apache.org (ASF Mail Server at gitbox.apache.org, from userid 33) id DC7118D80F; Fri, 13 Dec 2019 13:03:46 +0000 (UTC) Date: Fri, 13 Dec 2019 13:03:45 +0000 To: "commits@ignite.apache.org" Subject: [ignite] branch ignite-12248 updated (d8263c4 -> 1958c3e) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit Message-ID: <157624222512.25802.13307951812346390845@gitbox.apache.org> From: gvvinblade@apache.org X-Git-Host: gitbox.apache.org X-Git-Repo: ignite X-Git-Refname: refs/heads/ignite-12248 X-Git-Reftype: branch X-Git-Oldrev: d8263c423c1c07fed16fc64d932a1067ffefc4e9 X-Git-Newrev: 1958c3e542b8b0d8a9491678f5270cd53f56abd1 X-Git-NotificationType: ref_changed X-Git-Multimail-Version: 1.5.dev Auto-Submitted: auto-generated This is an automated email from the ASF dual-hosted git repository. gvvinblade pushed a change to branch ignite-12248 in repository https://gitbox.apache.org/repos/asf/ignite.git. discard d8263c4 ExchangeService API discard 255e289 Turn implementor to visitor omit aa3a0d9 planner rethinking, small refactoring omit b45e813 planner rethinking omit 8cdb219 query execution omit 4c8a246 simple execution omit 1824145 context refactoring omit 96281cf pending omit a77161f refactoring omit 7895303 pending omit ecbb326 pending omit c082b7b pending omit 4584e07 refactoring omit e1274e2 refactoring omit 4a842bf refactoring omit b85b901 pending omit 525dfdb pending omit c33076c pending omit 9125a61 pending omit e33767e pending omit 1995d3b pending omit e18d8a1 pending omit e797a6e pending omit 9179fd0 pending omit 2413ae0 Merge branch 'ignite-master' into ignite-12248 omit fc01a9d Merge branch 'ignite-master' into ignite-12248 omit accb91d fix after merge omit 4219f2d Merge branch 'ignite-master' into ignite-12248 omit aa5b981 IGNITE-12248: Apache Calcite based query execution engine. omit ce8737f IGNITE-12248: Apache Calcite based query execution engine. omit 6bee086 IGNITE-12248: Apache Calcite based query execution engine. omit d4aadae IGNITE-12248: Apache Calcite based query execution engine. add 1550781 IGNITE-12267: ClassCastException after change column type (drop then add). This closes #6945. add a6e577e IGNITE-12302 Fixed broken ZookeeperDiscoveryTopologyChangeAndReconnectTest.testDuplicatedNodeId - Fixes #6986. add 2035f9d IGNITE-12305 Extend test coverage [IGNITE-11959] NullPointerException if transaction failed and failure handler dwas not configured explicitly - Fixes #6993. add 7711fc9 IGNITE-12292 Java thin client: Fixed transaction issue in case of txId intersection - Fixes #6979. add c55d91d IGNITE-12324 Exception is masked in fieldOrder method with binary object of unregistered type - Fixes #7002. add d7be87e IGNITE-12325 Enable deferred delete for caches with enabled cache store. - Fixes #7005. add de43f96 Updated readme file removing outdated and redundant content add 1578935 IGNITE-11709 .NET Thin Client: introduce Cluster API add 4409582 IGNITE-9732: [Spark] Add joins to Spark Dataframe examples (#6963) add 6c41ed2 IGNITE-12328 IgniteException "Failed to resolve nodes topology" during cache.removeAll() and constantly changing topology - Fixes #7015. add d11b4bb IGNITE-12333: [ML] Cleanup the ML module code (#7024) add 8dbea36 IGNITE-12339: [ML] Remove outdated property isDistributed in Vector and Matrix classes (#7026) add 06c8a51 IGNITE-12336 Fixed creation of redundant CacheMetricsImpl instance in case of near cache is configured add 7d4bb49 IGNITE-12329 Invalid handling of remote entries causes partition desync and transaction hanging in COMMITTING state. - Fixes #7018. add 768c226 IGNITE-12329 Fixed license add 32fe1f0 IGNITE-12279: [ML] Added support for using H2O MOJO for model inference (#6964) add 299cf813e IGNITE-12277 Enable SQL index usage for mixed IN and EQUALS queries - Fixes #7029. add 4ce6826 IGNITE-12338 Use IgniteThread to notify about long query - Fixes #7025. add 720706d IGNITE-12316 Extend test coverage [IGNITE-10761] GridCacheProcessor should add info about cache in exception message, if applicable - Fixes #6995 add 7d5749e IGNITE-5247 Always use LITTLE_ENDIAN for communication SPI - Fixes #7023. add 1bb32a7 IGNITE-12300 Use initiating node security context in ComputeJob.cancel - Fixes #7017. add bdb225c IGNITE-9033 .NET Thin Client: add cache expiry policies add cee9615 IGNITE-12189 Implement correct limit for TextQuery - Fixes #6917. add dd5d9f3 IGNITE-12366: Cancel file transmission on a node-receiver (#7045) add bfcb0c3 IGNITE-12351 Append additional cp tracking activity - pages sort - Fixes #7036. add d72a123 IGNITE-11898 Java thin client: Affinity awareness support - Fixes #6980. add b821f8d IGNITE-12367-17424 Disable by default bash pipefail/errexit/nounset options from Ignite startup scripts add 26698ed IGNITE-10760 Fix confusing message about system worker blocking add 6ed0330 IGNITE-12323 Fixed flaky test GridCommandHandlerTest.testBaselineAutoAdjustmentAutoRemoveNode - Fixes #7001. add 0140234 IGNITE-7285 Add default query timeout - Fixes #6490. add c6696e5 IGNITE-6267 .NET: Get rid of Doxygen-specific files (#7053) add dcff79c IGNITE-12377 .NET: Add IBinaryObjectBuilder.SetField(name, val, type) add 567f65a IGNITE-12369 Fix compatibility between JdbcThinClient and Server - Fixes #7050. add 7464044 IGNITE-12223: Scan query system view (#7007) add ba42b59 Extend test coverage [IGNITE-11967] control.sh validate_indexes SQL Index issue must contain information about cache group - Fixes #6996. add 8701974 IGNITE-12224: SQL query & SQL query history system views. (#7059) add 839b414 IGNITE-12373: file transfer must skip recovery descriptor reservation for a channel connection (#7051) add 250f4a0 IGNITE-12386: TcpDiscoveryVmIpFinder must be used by default for security testInvalidServer (#7063) add 08cca28 IGNITE-12390 .NET: Add NuGet verification script add 8071692 IGNITE-12388 Fixed flaky ZookeeperDiscoveryClientReconnectTest.testReconnectServersRestart_3 - Fixes #7064. add 27b93ae IGNITE-12185: New metric. Index rebuild in progress flag for caches and tables. (#6983) add e66bbef IGNITE-12219: Cache operations performance metrics (#7076) add bb87041 IGNITE-12394 Fix log level for messages and thread dumps for ignored failures add 31506f0 IGNITE-12392 Faster transaction rolled back when one of backup node failed - Fixes #7072. add c28cefb IGNITE-12340 Extend test coverage of ability to track system/user time held in transaction - Fixes #7027. add 6695709 IGNITE-12402: Unsatisfied dependency for HibernateL2CacheExample fixed (#7088) add 85cf73f IGNITE-12124 Fixed possible NullPointerException/Error related to the cache stop with configured TTL add 4fb139d IGNITE-12399 Java thin client: add cache expiry policies - Fixes #7085. add b6082be IGNITE-12053: Total time threads parked if checkpoint throttling occurred metric added (#7080) add 1599912 IGNITE-12353 Additional sql benchmarks which covers Date types and inlining usage. This closes #7040. add a5bc728 IGNITE-12405 .NET: Remove WithReadRepair, deprecate WithAllowAtomicOpsInTx add c6cf3d9 IGNITE-12411: [ML] Finish ML API and fix typos in method names (#7096) add 64c56bc IGNITE-12413 .NET: Fix xmldoc file extension for case-sensitive file systems add 6d72874 IGNITE-12393: Striped thread pool queue system view. (#7084) add 9265c04 Revert "IGNITE-11704 Write tombstones during rebalance to get rid of deferred delete buffer" (#7100) add e6a7f93 IGNITE-12303 Fix a comment for an enumeration item SecurityPermission.CACHE_DESTROY - Fixes #7101. add 98883f1 IGNITE-12409 Destroying a cache during cache load may lead to a hang - Fixes #7092. add 299e3c9 IGNITE-12188 Fixed CacheGroupMetrics.IndexBuildCountPartitionsLeft metric - Fixes #7078. add 9f3b915 IGNITE-12420 Fix broken the Check Code Style suite - Fixes #7105. add c0e8d2d IGNITE-12421: Update master branch project version to 2.9.0-SNAPSHOT (#7106) add 3ac9a21 IGNITE-11410 Sandbox for user-defined code - Fixes #6707. add c6696de IGNITE-12423: PME duration histogram updates only if log info enabled (#7108) add 15993fa IGNITE-11857 PartitionTxUpdateCounter optimization - Fixes #6686. add cec6dc4 IGNITE-12419 Fixed JCache TCK CacheLoader checks - Fixes #7103. add b694fd1 IGNITE-12365 Concurrent removeAll() on the same cache leads to deadlock - Fixes #7111. add 966b642 IGNITE-12421: update resources with 2.9.0-SNAPSHOT version (#7126) add 0c162e5 IGNITE-12247: [Spark] Add initial support of Spark 2.4 (#7058) new 1958c3e IGNITE-12248: Apache Calcite based query execution engine. Initial commit. This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (d8263c4) \ N -- N -- N refs/heads/ignite-12248 (1958c3e) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: README.md | 260 +-- bin/control.sh | 13 +- bin/ignite-tf.sh | 13 +- bin/ignite.sh | 13 +- bin/ignitevisorcmd.sh | 13 +- bin/include/functions.sh | 13 +- bin/include/parseargs.sh | 13 +- bin/include/setenv.sh | 13 +- examples/pom-standalone-lgpl.xml | 55 + examples/pom-standalone.xml | 56 + examples/pom.xml | 59 +- .../ml/TrainingWithBinaryObjectExample.java | 6 +- .../clustering/CustomersClusterizationExample.java | 32 +- .../ml/clustering/GmmClusterizationExample.java | 2 +- .../dataset/AlgorithmSpecificDatasetExample.java | 2 +- .../TrainingWithCustomPreprocessorsExample.java | 13 +- .../change/OptimizeMakeChangeFitnessFunction.java | 2 +- .../change/OptimizeMakeChangeGAExample.java | 2 +- .../helloworld/HelloWorldFitnessFunction.java | 2 +- .../genetic/knapsack/KnapsackFitnessFunction.java | 4 +- .../knapsack/KnapsackTerminateCriteria.java | 2 +- .../ml/genetic/movie/MovieFitnessFunction.java | 4 +- .../inference/h2o/H2OMojoModelParserExample.java | 103 + .../h2o}/package-info.java | 4 +- .../examples/ml/knn/KNNRegressionExample.java | 2 +- .../ml/naivebayes/CompoundNaiveBayesExample.java | 1 + .../examples/ml/naivebayes/package-info.java | 2 +- .../ignite/examples/ml/nn/MLPTrainerExample.java | 48 - .../ml/preprocessing/encoding/EncoderExample.java | 4 +- .../encoding/EncoderExampleWithNormalization.java | 4 +- .../encoding/LabelEncoderExample.java | 14 +- .../examples/ml/preprocessing/package-info.java | 2 +- .../ml/recommendation/MovieLensExample.java | 6 +- .../ml/recommendation/MovieLensSQLExample.java | 6 +- .../linear/BostonHousePricesPredictionExample.java | 2 +- .../linear/LinearRegressionLSQRTrainerExample.java | 2 +- .../selection/scoring/RegressionMetricExample.java | 2 +- ...eeClassificationTrainerSQLInferenceExample.java | 26 +- ...onTreeClassificationTrainerSQLTableExample.java | 20 +- .../ignite/examples/ml/sql/package-info.java | 2 +- .../examples/ml/tree/FraudDetectionExample.java | 3 +- .../RandomForestRegressionExample.java | 4 +- .../ignite/examples/ml/tutorial/Step_8_CV.java | 6 +- .../ml/tutorial/Step_8_CV_with_Param_Grid.java | 10 +- .../Step_8_CV_with_Param_Grid_and_metrics.java | 10 +- ...V_with_Param_Grid_and_metrics_and_pipeline.java | 10 +- .../hyperparametertuning/Step_13_RandomSearch.java | 8 +- .../Step_14_Parallel_BrutForce_Search.java | 10 +- .../Step_15_Parallel_Random_Search.java | 10 +- .../Step_16_Genetic_Programming_Search.java | 8 +- ...tep_17_Parallel_Genetic_Programming_Search.java | 10 +- .../ParametricVectorGeneratorExample.java | 2 +- .../util/generators/StandardGeneratorsExample.java | 14 +- .../generators/VectorGeneratorFamilyExample.java | 4 +- .../VectorGeneratorPrimitivesExample.java | 11 +- .../{titanik_test.csv => titanic_test.csv} | 0 .../{titanik_train.csv => titanic_train.csv} | 0 .../resources/models/h2o/agaricus-gbm-mojo.zip | Bin 0 -> 62818 bytes .../spark/IgniteDataFrameJoinExample.scala | 180 ++ .../spark/JavaIgniteDataFrameJoinExample.java | 164 ++ .../spark/examples/IgniteDataFrameSelfTest.java | 9 + .../examples/JavaIgniteDataFrameSelfTest.java | 9 + modules/aop/pom.xml | 2 +- modules/apache-license-gen/pom.xml | 2 +- modules/aws/pom.xml | 2 +- modules/benchmarks/pom.xml | 2 +- .../misc/JmhPartitionUpdateCounterBenchmark.java | 112 + .../query/calcite/util/TableScanIterator.java | 2 +- modules/camel/pom.xml | 2 +- modules/cassandra/pom.xml | 2 +- modules/cassandra/serializers/pom.xml | 4 +- modules/cassandra/store/pom.xml | 4 +- modules/clients/pom.xml | 2 +- .../internal/jdbc2/JdbcMetadataSelfTest.java | 9 +- .../thin/JdbcThinAffinityAwarenessSelfTest.java | 4 +- ...cThinAffinityAwarenessTransactionsSelfTest.java | 4 +- .../ignite/jdbc/thin/JdbcThinMetadataSelfTest.java | 105 +- modules/cloud/pom.xml | 2 +- modules/codegen/pom.xml | 2 +- .../SystemViewRowAttributeWalkerGenerator.java | 26 +- modules/compatibility/pom.xml | 2 +- modules/compress/pom.xml | 2 +- modules/core/pom.xml | 2 +- .../apache/ignite/cache/query/SqlFieldsQuery.java | 5 +- .../org/apache/ignite/cache/query/TextQuery.java | 50 + .../java/org/apache/ignite/client/ClientCache.java | 9 + .../ignite/client/ClientCacheConfiguration.java | 20 + .../ignite/configuration/ClientConfiguration.java | 73 + .../ignite/configuration/IgniteConfiguration.java | 36 + .../org/apache/ignite/internal/IgniteKernal.java | 2 + .../internal/StripedExecutorMXBeanAdapter.java | 2 +- .../ignite/internal/binary/BinaryFieldImpl.java | 15 +- .../ignite/internal/client/thin/ClientBinary.java | 3 +- .../client/thin/ClientCacheAffinityContext.java | 227 ++ .../client/thin/ClientCacheAffinityMapping.java | 269 +++ .../ignite/internal/client/thin/ClientChannel.java | 17 + .../client/thin/ClientChannelConfiguration.java | 70 +- .../internal/client/thin/ClientOperation.java | 1 + .../ignite/internal/client/thin/ClientUtils.java | 31 +- .../internal/client/thin/ProtocolVersion.java | 5 +- .../internal/client/thin/ReliableChannel.java | 344 ++- .../internal/client/thin/TcpClientCache.java | 189 +- .../internal/client/thin/TcpClientChannel.java | 42 +- .../client/thin/TcpClientTransactions.java | 42 +- .../internal/client/thin/TcpIgniteClient.java | 23 +- .../internal/cluster/ClusterGroupAdapter.java | 12 +- .../managers/communication/GridIoManager.java | 6 + .../communication/GridIoMessageFactory.java | 6 - .../TransmissionCancelledException.java} | 44 +- .../communication/TransmissionHandler.java | 10 + .../managers/communication/TransmissionMeta.java | 2 +- .../deployment/GridDeploymentClassLoader.java | 17 +- .../managers/systemview/GridSystemViewManager.java | 51 + .../managers/systemview/ScanQuerySystemView.java | 213 ++ .../systemview/walker/ScanQueryViewWalker.java | 79 + .../walker/SqlQueryHistoryViewWalker.java | 59 + .../systemview/walker/SqlQueryViewWalker.java | 58 + .../walker/StripedExecutorTaskViewWalker.java | 50 + .../apache/ignite/internal/pagemem/FullPageId.java | 7 + .../apache/ignite/internal/pagemem/PageUtils.java | 4 +- .../internal/pagemem/wal/record/WALRecord.java | 5 +- .../delta/MetaPageUpdatePartitionDataRecord.java | 19 +- .../delta/MetaPageUpdatePartitionDataRecordV2.java | 22 +- .../delta/MetaPageUpdatePartitionDataRecordV3.java | 108 - .../processors/cache/CacheGroupContext.java | 19 - .../processors/cache/CacheGroupMetricsImpl.java | 29 +- .../processors/cache/CacheMetricsImpl.java | 88 +- .../internal/processors/cache/CacheObject.java | 3 - .../processors/cache/GridCacheAdapter.java | 16 +- .../processors/cache/GridCacheContext.java | 21 +- .../processors/cache/GridCacheIdMessage.java | 2 +- .../processors/cache/GridCacheMapEntry.java | 343 ++- .../internal/processors/cache/GridCacheMvcc.java | 3 +- .../cache/GridCachePartitionExchangeManager.java | 4 +- .../processors/cache/GridCacheProcessor.java | 15 +- .../processors/cache/GridCacheSharedContext.java | 5 +- .../cache/GridCacheSharedTtlCleanupManager.java | 94 +- .../processors/cache/GridCacheTtlManager.java | 9 + .../cache/IgniteCacheOffheapManager.java | 93 +- .../cache/IgniteCacheOffheapManagerImpl.java | 395 +--- .../processors/cache/IgniteCacheProxyImpl.java | 22 +- .../processors/cache/IncompleteCacheObject.java | 19 - .../processors/cache/IncompleteObject.java | 2 +- .../cache/PartitionTxUpdateCounterImpl.java | 153 +- .../processors/cache/PartitionUpdateCounter.java | 4 +- .../processors/cache/TombstoneCacheObject.java | 94 - .../binary/CacheObjectBinaryProcessorImpl.java | 6 +- .../distributed/GridDistributedCacheAdapter.java | 106 +- .../distributed/GridDistributedCacheEntry.java | 19 +- .../GridDistributedTxRemoteAdapter.java | 47 +- .../cache/distributed/dht/GridDhtCache.java | 7 +- .../cache/distributed/dht/GridDhtCacheAdapter.java | 29 +- .../cache/distributed/dht/GridDhtLockFuture.java | 2 +- .../dht/GridDhtTransactionalCacheAdapter.java | 2 +- .../distributed/dht/GridDhtTxFinishFuture.java | 27 +- .../distributed/dht/GridDhtTxLocalAdapter.java | 2 +- .../distributed/dht/GridDhtTxPrepareFuture.java | 14 +- .../cache/distributed/dht/GridDhtTxRemote.java | 8 +- .../distributed/dht/atomic/GridDhtAtomicCache.java | 17 +- .../dht/colocated/GridDhtColocatedLockFuture.java | 39 +- .../preloader/GridDhtPartitionsExchangeFuture.java | 5 +- .../dht/topology/GridDhtLocalPartition.java | 307 +-- .../dht/topology/GridDhtPartitionTopologyImpl.java | 5 +- .../dht/topology/PartitionsEvictManager.java | 366 +-- .../cache/distributed/near/GridNearLockFuture.java | 4 - .../distributed/near/GridNearTxPrepareRequest.java | 3 +- .../cache/local/GridLocalCacheEntry.java | 22 +- .../processors/cache/persistence/CacheDataRow.java | 5 - .../cache/persistence/CacheDataRowAdapter.java | 61 +- .../cache/persistence/DataRegionMetricsImpl.java | 13 + .../GridCacheDatabaseSharedManager.java | 33 +- .../cache/persistence/GridCacheOffheapManager.java | 369 ++- .../IgniteCacheDatabaseSharedManager.java | 104 +- .../pagemem/CheckpointMetricsTracker.java | 76 +- .../cache/persistence/pagemem/PageMemoryImpl.java | 18 +- .../pagemem/PagesWriteSpeedBasedThrottle.java | 2 + .../persistence/pagemem/PagesWriteThrottle.java | 4 + .../persistence/tree/io/PagePartitionMetaIO.java | 29 +- .../persistence/tree/io/PagePartitionMetaIOV2.java | 25 +- .../wal/serializer/RecordDataV1Serializer.java | 11 - .../processors/cache/query/CacheQuery.java | 8 + .../query/GridCacheDistributedQueryManager.java | 3 + .../cache/query/GridCacheQueryAdapter.java | 20 + .../cache/query/GridCacheQueryFutureAdapter.java | 109 +- .../cache/query/GridCacheQueryManager.java | 134 +- .../cache/query/GridCacheQueryRequest.java | 41 +- .../cache/transactions/IgniteInternalTx.java | 4 +- .../cache/transactions/IgniteTxAdapter.java | 10 +- .../cache/transactions/IgniteTxEntry.java | 5 +- .../cache/transactions/IgniteTxHandler.java | 14 +- .../cache/transactions/IgniteTxManager.java | 11 +- .../cache/transactions/IgniteTxRemoteEx.java | 5 +- .../IgniteTxRemoteSingleStateImpl.java | 3 +- .../cache/transactions/IgniteTxRemoteState.java | 6 +- .../transactions/IgniteTxRemoteStateImpl.java | 22 +- .../internal/processors/cache/tree/DataRow.java | 6 +- .../continuous/GridContinuousProcessor.java | 2 +- .../processors/datastreamer/DataStreamerImpl.java | 20 +- .../datastreamer/DataStreamerUpdateJob.java | 13 +- .../processors/failure/FailureProcessor.java | 35 +- .../internal/processors/job/GridJobWorker.java | 14 +- .../processors/metric/GridMetricManager.java | 2 +- .../processors/metric/impl/MetricUtils.java | 9 - .../processors/odbc/ClientListenerProcessor.java | 2 +- .../odbc/ClientListenerRequestHandler.java | 8 + .../processors/odbc/jdbc/JdbcRequestHandler.java | 2 +- .../processors/odbc/odbc/OdbcRequestHandler.java | 9 +- .../processors/platform/cache/PlatformCache.java | 5 + .../cache/expiry/PlatformExpiryPolicy.java | 17 + .../platform/client/ClientConnectionContext.java | 6 +- .../platform/client/ClientMessageParser.java | 29 + .../platform/client/ClientRequestHandler.java | 4 + .../cache/ClientCacheConfigurationSerializer.java | 12 + .../platform/client/cache/ClientCacheRequest.java | 28 +- .../cache/ClientCacheSqlFieldsQueryRequest.java | 6 +- .../cluster/ClientClusterChangeStateRequest.java | 49 + .../cluster/ClientClusterIsActiveRequest.java | 45 + .../ClientClusterWalChangeStateRequest.java | 55 + .../ClientClusterWalChangeStateResponse.java} | 39 +- .../cluster/ClientClusterWalGetStateRequest.java | 49 + .../platform/utils/PlatformConfigurationUtils.java | 4 +- .../processors/query/GridQueryIndexing.java | 3 +- .../processors/query/GridQueryProcessor.java | 48 +- .../processors/query/GridRunningQueryInfo.java | 11 +- ...{QueryHistoryMetrics.java => QueryHistory.java} | 22 +- ...HistoryMetricsKey.java => QueryHistoryKey.java} | 6 +- .../processors/query/QueryHistoryTracker.java | 42 +- .../processors/query/RunningQueryManager.java | 35 +- .../query/schema/SchemaIndexCacheVisitorImpl.java | 40 +- .../processors/resource/GridResourceProcessor.java | 12 + .../GridResourceProxiedIgniteInjector.java | 88 + .../processors/security/GridSecurityProcessor.java | 12 + .../processors/security/IgniteSecurity.java | 11 +- .../security/IgniteSecurityProcessor.java | 25 + .../security/NoOpIgniteSecurityProcessor.java | 11 + .../processors/security/SecurityUtils.java | 122 + .../security/sandbox/AccessControllerSandbox.java | 74 + .../security/sandbox/IgniteDomainCombiner.java | 52 + .../processors/security/sandbox/IgniteSandbox.java | 46 + .../processors/security/sandbox/NoOpSandbox.java} | 21 +- .../sandbox/SandboxIgniteComponentProxy.java | 110 + .../apache/ignite/internal/util/IgniteUtils.java | 54 +- .../ignite/internal/util/StripedExecutor.java | 157 +- .../ignite/internal/util/nio/GridNioServer.java | 2 +- .../ignite/internal/worker/WorkersRegistry.java | 7 +- .../ignite/plugin/security/SecurityPermission.java | 2 +- .../ignite/plugin/security/SecuritySubject.java | 12 + .../spi/communication/tcp/TcpCommunicationSpi.java | 18 +- .../tcp/messages/HandshakeMessage2.java | 2 +- .../ignite/spi/systemview/view/ScanQueryView.java | 170 ++ .../spi/systemview/view/SqlQueryHistoryView.java | 85 + .../ignite/spi/systemview/view/SqlQueryView.java | 79 + .../systemview/view/StripedExecutorTaskView.java | 68 + modules/core/src/main/resources/ignite.properties | 2 +- modules/core/src/test/config/log4j-test.xml | 23 +- .../apache/ignite/cache/RemoveAllDeadlockTest.java | 95 + .../org/apache/ignite/client/FunctionalTest.java | 114 +- .../org/apache/ignite/client/ReliabilityTest.java | 116 + .../binary/BinaryFieldExtractionSelfTest.java | 46 +- .../ThinClientAbstractAffinityAwarenessTest.java | 322 +++ ...nClientAffinityAwarenessStableTopologyTest.java | 206 ++ ...lientAffinityAwarenessUnstableTopologyTest.java | 220 ++ .../GridIoManagerFileTransmissionSelfTest.java | 142 +- .../ignite/internal/metric/JmxExporterSpiTest.java | 249 ++ .../ignite/internal/metric/SystemViewSelfTest.java | 329 ++- .../cache/CacheDeferredDeleteSanitySelfTest.java | 6 +- .../cache/CacheLockCandidatesThreadTest.java | 6 +- .../cache/ClientSlowDiscoveryAbstractTest.java | 121 + ... => ClientSlowDiscoveryTopologyChangeTest.java} | 105 +- .../ClientSlowDiscoveryTransactionRemapTest.java | 473 ++++ .../cache/GridCacheAbstractFullApiSelfTest.java | 7 +- .../cache/GridCacheAbstractMetricsSelfTest.java | 74 + ...ridCacheFullTextQueryMultithreadedSelfTest.java | 3 +- .../cache/GridCacheProcessorActiveTxTest.java | 248 ++ .../GridTransactionsSystemUserTimeMetricsTest.java | 724 +++++- .../IgniteCacheConfigVariationsFullApiTest.java | 2 +- .../processors/cache/SafeLogTxFinishErrorTest.java | 161 ++ .../CacheRemoveWithTombstonesLoadTest.java | 414 ---- .../distributed/CacheRemoveWithTombstonesTest.java | 289 --- .../distributed/CacheRentingStateRepairTest.java | 3 +- ...omicClientInvalidPartitionHandlingSelfTest.java | 10 + ...acheAtomicInvalidPartitionHandlingSelfTest.java | 4 +- .../CacheRemoveWithTombstonesFailoverTest.java | 187 -- .../DropCacheContextDuringEvictionTest.java | 24 +- .../PartitionsEvictManagerAbstractTest.java | 113 +- .../PartitionsEvictionTaskFailureHandlerTest.java | 72 +- .../GridCacheFastNodeLeftForTransactionTest.java | 394 ++++ .../db/CheckpointBufferDeadlockTest.java | 4 +- .../cache/persistence/db/IgnitePdsWithTtlTest.java | 8 + .../db/checkpoint/CheckpointStartLoggingTest.java | 101 + .../pagemem/BPlusTreePageMemoryImplTest.java | 4 + .../BPlusTreeReuseListPageMemoryImplTest.java | 4 + .../pagemem/IgniteThrottlingUnitTest.java | 15 + .../pagemem/IndexStoragePageMemoryImplTest.java | 4 + .../pagemem/PageMemoryImplNoLoadTest.java | 4 + .../persistence/pagemem/PageMemoryImplTest.java | 14 + .../pagemem/PagesWriteThrottleSmokeTest.java | 29 +- .../TxCrossCacheMapOnInvalidTopologyTest.java | 134 +- .../TxCrossCachePartitionConsistencyTest.java | 320 +++ ...acheRemoteMultiplePartitionReservationTest.java | 165 ++ .../TxPartitionCounterStateAbstractTest.java | 12 +- .../TxPartitionCounterStateConsistencyTest.java | 134 +- ...nterStateConsistencyVolatileRebalanceTest.java} | 47 +- .../processors/database/CacheFreeListSelfTest.java | 5 - .../datastreamer/DataStreamerStopCacheTest.java | 213 ++ .../failure/FailureProcessorLoggingTest.java | 270 +++ .../processors/query/DummyQueryIndexing.java | 3 +- .../AbstractRemoteSecurityContextCheckTest.java | 29 +- .../processors/security/AbstractSecurityTest.java | 107 +- .../processors/security/InvalidServerTest.java | 2 +- .../cache/EntryProcessorPermissionCheckTest.java | 2 +- .../CacheLoadRemoteSecurityContextCheckTest.java | 43 +- .../compute/ComputePermissionCheckTest.java | 53 +- ...teTaskCancelRemoteSecurityContextCheckTest.java | 195 ++ .../processors/security/impl/TestSecurityData.java | 22 +- .../security/impl/TestSecurityPluginProvider.java | 17 +- .../security/impl/TestSecurityProcessor.java | 21 +- .../security/impl/TestSecuritySubject.java | 16 + .../security/sandbox/AbstractSandboxTest.java | 128 ++ .../security/sandbox/CacheSandboxTest.java | 134 ++ .../security/sandbox/ComputeSandboxTest.java | 146 ++ .../security/sandbox/DataStreamerSandboxTest.java | 57 + .../sandbox/DoPrivilegedOnRemoteNodeTest.java | 180 ++ .../sandbox/IgniteOperationsInsideSandboxTest.java | 234 ++ .../sandbox/SecuritySubjectPermissionsTest.java | 132 ++ .../ignite/testsuites/IgniteBasicTestSuite.java | 4 +- .../testsuites/IgniteCacheMvccTestSuite5.java | 2 + .../testsuites/IgniteCacheMvccTestSuite7.java | 2 + .../testsuites/IgniteCacheMvccTestSuite9.java | 22 +- .../ignite/testsuites/IgniteCacheTestSuite.java | 2 + .../ignite/testsuites/IgniteCacheTestSuite2.java | 2 + .../ignite/testsuites/IgniteCacheTestSuite4.java | 3 + .../ignite/testsuites/IgniteCacheTestSuite5.java | 6 +- .../ignite/testsuites/IgniteCacheTestSuite7.java | 5 + .../ignite/testsuites/IgniteCacheTestSuite9.java | 13 +- .../ignite/testsuites/IgnitePdsTestSuite2.java | 3 + .../ignite/testsuites/IgniteReproducingSuite.java | 5 +- .../ignite/testsuites/SecurityTestSuite.java | 18 +- .../apache/ignite/util/GridCommandHandlerTest.java | 41 +- modules/dev-utils/ignite-modules-test/build.gradle | 3 +- modules/dev-utils/pom.xml | 2 +- modules/direct-io/pom.xml | 2 +- modules/extdata/p2p/pom.xml | 2 +- modules/extdata/platform/pom.xml | 2 +- modules/extdata/uri/modules/uri-dependency/pom.xml | 2 +- modules/extdata/uri/pom.xml | 2 +- modules/flink/pom.xml | 2 +- modules/flume/pom.xml | 2 +- modules/gce/pom.xml | 2 +- modules/geospatial/pom.xml | 2 +- modules/hadoop/pom.xml | 2 +- modules/hibernate-4.2/pom.xml | 2 +- modules/hibernate-5.1/pom.xml | 2 +- modules/hibernate-5.3/pom.xml | 2 +- modules/hibernate-core/pom.xml | 2 +- modules/ignored-tests/pom.xml | 2 +- modules/indexing/pom.xml | 2 +- .../systemview/walker/SqlTableViewWalker.java | 4 +- .../processors/query/h2/IgniteH2Indexing.java | 20 +- .../query/h2/LongRunningQueryManager.java | 8 +- .../processors/query/h2/QueryParameters.java | 39 +- .../internal/processors/query/h2/QueryParser.java | 56 +- .../processors/query/h2/SchemaManager.java | 4 - .../query/h2/database/H2PkHashIndex.java | 4 +- .../processors/query/h2/opt/GridH2Table.java | 2 +- .../processors/query/h2/opt/GridLuceneIndex.java | 5 +- .../processors/query/h2/opt/H2CacheRow.java | 5 - .../sys/view/SqlSystemViewQueryHistoryMetrics.java | 92 - .../h2/sys/view/SqlSystemViewRunningQueries.java | 101 - .../processors/query/h2/twostep/ReduceTable.java | 2 +- .../query/h2/twostep/ReduceTableWrapper.java | 2 +- .../ignite/spi/systemview/SqlViewExporterSpi.java | 8 +- .../ignite/spi/systemview/view/SqlTableView.java | 5 + .../org/apache/ignite/client/ClientTestSuite.java | 6 +- .../CacheGroupMetricsWithIndexBuildFailTest.java | 187 ++ .../cache/CacheGroupMetricsWithIndexTest.java | 50 +- .../cache/GridCacheFullTextQuerySelfTest.java | 224 +- ...acheDistributedQueryDefaultTimeoutSelfTest.java | 197 ++ .../cache/index/AbstractIndexingCommonTest.java | 71 + .../processors/cache/index/BasicIndexTest.java | 122 +- .../processors/cache/index/IndexMetricsTest.java | 153 ++ ...gniteCacheLocalQueryDefaultTimeoutSelfTest.java | 152 ++ .../cache/metric/SqlViewExporterSpiTest.java | 280 ++- .../query/IgniteSqlKeyValueFieldsTest.java | 194 +- .../processors/query/LongRunningQueryTest.java | 52 +- .../processors/query/SqlQueryHistorySelfTest.java | 16 +- .../processors/query/SqlSystemViewsSelfTest.java | 119 +- .../IgniteBinaryCacheQueryTestSuite.java | 2 + .../IgniteBinaryCacheQueryTestSuite2.java | 7 +- .../IgniteCacheWithIndexingTestSuite.java | 2 + ...idCommandHandlerIndexingClusterByClassTest.java | 19 + modules/jcl/pom.xml | 2 +- modules/jms11/pom.xml | 2 +- modules/jta/pom.xml | 2 +- modules/kafka/pom.xml | 2 +- modules/kubernetes/pom.xml | 2 +- modules/log4j/pom.xml | 2 +- modules/log4j2/pom.xml | 2 +- modules/mesos/pom.xml | 2 +- .../pom.xml | 14 +- .../org/apache/ignite/ml/h2o/H2OMojoModel.java | 88 + .../apache/ignite/ml/h2o/H2OMojoModelParser.java | 86 + .../org/apache/ignite/ml/h2o}/package-info.java | 5 +- .../apache/ignite/ml/h2o/H2OMojoParserTest.java | 68 + .../org/apache/ignite/ml/h2o/H2OMojoTestSuite.java | 16 +- .../src/test/resources/mojos/gbm_prostate.zip | Bin 0 -> 42484 bytes modules/ml/mleap-model-parser/pom.xml | 2 +- modules/ml/pom.xml | 2 +- modules/ml/spark-model-parser/pom.xml | 2 +- .../ml/sparkmodelparser/SparkModelParser.java | 7 +- .../ml/sparkmodelparser/SupportedSparkModels.java | 4 + .../UnsupportedSparkModelException.java | 6 +- .../ml/sparkmodelparser/SparkModelParserTest.java | 3 +- .../java/org/apache/ignite/ml/FileExporter.java | 2 +- .../gmm/CovarianceMatricesAggregator.java | 33 +- .../apache/ignite/ml/clustering/gmm/GmmModel.java | 2 +- .../ignite/ml/clustering/gmm/GmmTrainer.java | 16 +- .../ml/composition/bagging/BaggedTrainer.java | 1 - .../composition/boosting/GDBLearningStrategy.java | 3 +- .../boosting/convergence/package-info.java | 2 +- .../ml/composition/combinators/package-info.java | 2 +- .../combinators/parallel/package-info.java | 2 +- .../sequential/TrainersSequentialComposition.java | 2 +- .../stacking/SimpleStackedDatasetTrainer.java | 1 - .../ml/dataset/feature/extractor/Vectorizer.java | 2 +- .../extractor/impl/BinaryObjectVectorizer.java | 6 +- .../extractor/impl/DoubleArrayVectorizer.java | 8 +- .../feature/extractor/impl/DummyVectorizer.java | 8 +- .../BootstrappedDatasetPartition.java | 2 +- .../ml/dataset/impl/cache/CacheBasedDataset.java | 6 +- .../impl/cache/CacheBasedDatasetBuilder.java | 4 +- .../ml/dataset/impl/cache/util/ComputeUtils.java | 20 +- .../FeatureMatrixWithLabelsOnHeapDataBuilder.java | 2 +- .../builder/data/SimpleDatasetDataBuilder.java | 2 +- .../DefaultLearningEnvironmentBuilder.java | 4 +- .../ml/environment/deploy/DeployingContext.java | 4 +- .../environment/deploy/DeployingContextImpl.java | 21 +- .../ml/environment/logging/ConsoleLogger.java | 3 - .../org/apache/ignite/ml/genetic/CrossOverJob.java | 6 +- .../apache/ignite/ml/genetic/CrossOverTask.java | 4 +- .../org/apache/ignite/ml/genetic/FitnessJob.java | 12 +- .../org/apache/ignite/ml/genetic/FitnessTask.java | 2 +- .../java/org/apache/ignite/ml/genetic/GAGrid.java | 46 +- .../java/org/apache/ignite/ml/genetic/Gene.java | 4 +- .../org/apache/ignite/ml/genetic/MutateJob.java | 4 +- .../org/apache/ignite/ml/genetic/MutateTask.java | 10 +- .../ml/genetic/RouletteWheelSelectionJob.java | 10 +- .../ml/genetic/RouletteWheelSelectionTask.java | 8 +- .../ignite/ml/genetic/TruncateSelectionJob.java | 2 +- .../ignite/ml/genetic/TruncateSelectionTask.java | 10 +- .../ml/genetic/functions/GAGridFunction.java | 2 +- .../ml/genetic/parameter/ChromosomeCriteria.java | 2 +- .../ml/genetic/parameter/GAConfiguration.java | 23 +- .../ml/genetic/parameter/GAGridConstants.java | 4 +- .../ignite/ml/genetic/utils/GAGridUtils.java | 4 +- .../storage/model/DefaultModelStorage.java | 2 +- .../java/org/apache/ignite/ml/knn/KNNModel.java | 6 +- .../java/org/apache/ignite/ml/knn/KNNTrainer.java | 2 +- .../knn/classification/KNNClassificationModel.java | 2 +- .../classification/KNNClassificationTrainer.java | 2 +- .../ml/knn/regression/KNNRegressionTrainer.java | 2 +- .../ignite/ml/knn/utils/PointWithDistanceUtil.java | 2 +- .../ml/knn/utils/indices/ArraySpatialIndex.java | 4 +- .../ml/knn/utils/indices/BallTreeSpatialIndex.java | 6 +- .../ml/knn/utils/indices/KDTreeSpatialIndex.java | 6 +- .../apache/ignite/ml/math/StorageOpsMetrics.java | 5 - .../java/org/apache/ignite/ml/math/Tracer.java | 6 +- .../ignite/ml/math/distances/HammingDistance.java | 6 +- .../preprocessing/IllegalFeatureTypeException.java | 8 +- .../preprocessing/IllegalLabelTypeException.java | 8 +- .../apache/ignite/ml/math/functions/Functions.java | 7 +- .../ml/math/functions/IgniteCurriedBiFunction.java | 3 +- .../math/functions/IgniteCurriedTriFunction.java | 4 +- .../ignite/ml/math/functions/IgniteFunction.java | 2 +- .../ignite/ml/math/isolve/lsqr/AbstractLSQR.java | 8 +- .../ml/math/primitives/matrix/AbstractMatrix.java | 13 +- .../ignite/ml/math/primitives/matrix/Matrix.java | 2 +- .../ml/math/primitives/matrix/MatrixStorage.java | 2 +- .../matrix/storage/DenseMatrixStorage.java | 5 - .../matrix/storage/SparseMatrixStorage.java | 5 - .../matrix/storage/ViewMatrixStorage.java | 5 - .../ml/math/primitives/vector/AbstractVector.java | 19 +- .../ignite/ml/math/primitives/vector/Vector.java | 14 +- .../ml/math/primitives/vector/VectorUtils.java | 24 - .../primitives/vector/impl/DelegatingVector.java | 5 - .../vector/storage/DenseVectorStorage.java | 17 +- .../vector/storage/SparseVectorStorage.java | 5 - .../vector/storage/VectorViewStorage.java | 5 - .../storage/VectorizedViewMatrixStorage.java | 7 +- .../stat/MultivariateGaussianDistribution.java | 4 +- .../org/apache/ignite/ml/math/util/MatrixUtil.java | 4 + .../ignite/ml/multiclass/MultiClassModel.java | 3 +- .../ignite/ml/multiclass/OneVsRestTrainer.java | 4 +- .../apache/ignite/ml/naivebayes/BayesModel.java | 5 +- .../compound/CompoundNaiveBayesModel.java | 37 +- .../compound/CompoundNaiveBayesTrainer.java | 15 +- .../discrete/DiscreteNaiveBayesModel.java | 12 +- .../gaussian/GaussianNaiveBayesModel.java | 20 +- .../apache/ignite/ml/nn/MultilayerPerceptron.java | 21 +- .../ignite/ml/nn/ReplicatedVectorMatrix.java | 5 - .../ml/preprocessing/PreprocessingTrainer.java | 6 +- .../ignite/ml/preprocessing/Preprocessor.java | 2 +- .../developer/MappedPreprocessor.java | 2 +- .../encoding/EncoderPreprocessor.java | 4 +- .../frequency/FrequencyEncoderPreprocessor.java | 2 +- .../encoding/label/LabelEncoderPreprocessor.java | 4 +- .../stringencoder/StringEncoderPreprocessor.java | 4 +- .../VectorFinalizationPreprocessor.java | 2 +- .../ml/recommendation/RecommendationTrainer.java | 12 +- .../regressions/linear/LinearRegressionModel.java | 3 +- .../logistic/LogisticRegressionModel.java | 5 +- .../ml/selection/cv/AbstractCrossValidation.java | 10 +- .../ignite/ml/selection/paramgrid/ParamGrid.java | 2 +- .../ml/selection/paramgrid/RandomStrategy.java | 10 +- .../scoring/evaluator/EvaluationResult.java | 10 +- .../ml/selection/scoring/evaluator/Evaluator.java | 18 +- ...assificationPointwiseMetricStatsAggregator.java | 14 +- .../ClassificationMetricsAggregator.java | 36 +- .../aggregator/MetricStatsAggregator.java | 6 +- .../RegressionMetricStatsAggregator.java | 6 +- .../BinaryClassificationEvaluationContext.java | 82 +- .../evaluator/context/EvaluationContext.java | 4 +- .../metric/classification/BalancedAccuracy.java | 16 +- .../classification/BinaryClassificationMetric.java | 10 +- .../scoring/metric/classification/FMeasure.java | 4 +- .../scoring/metric/classification/FallOut.java | 1 - .../scoring/metric/classification/MissRate.java | 1 - .../scoring/metric/classification/Precision.java | 2 +- .../scoring/metric/classification/Recall.java | 2 +- .../selection/scoring/metric/regression/Mae.java | 3 +- .../selection/scoring/metric/regression/Mse.java | 3 +- .../ml/selection/scoring/metric/regression/R2.java | 3 +- .../selection/scoring/metric/regression/Rmse.java | 3 +- .../selection/scoring/metric/regression/Rss.java | 3 +- .../org/apache/ignite/ml/structures/Dataset.java | 24 +- .../apache/ignite/ml/structures/DatasetRow.java | 2 +- .../ignite/ml/structures/FeatureMetadata.java | 3 +- .../apache/ignite/ml/structures/LabeledVector.java | 1 - .../ignite/ml/structures/LabeledVectorSet.java | 37 +- .../partition/LabelPartitionDataBuilderOnHeap.java | 2 +- .../preprocessing/LabeledDatasetLoader.java | 10 +- .../ml/svm/SVMLinearClassificationModel.java | 5 +- .../ml/trainers/AdaptableDatasetTrainer.java | 4 +- .../apache/ignite/ml/trainers/DatasetTrainer.java | 2 +- .../GDBBinaryClassifierOnTreesTrainer.java | 2 +- .../ignite/ml/tree/data/DecisionTreeData.java | 11 +- .../ignite/ml/tree/impurity/util/StepFunction.java | 2 +- .../ml/tree/leaf/MeanDecisionTreeLeafBuilder.java | 2 +- .../ml/tree/randomforest/RandomForestTrainer.java | 2 +- .../data/FeaturesCountSelectionStrategies.java | 16 +- .../randomforest/data/impurity/GiniHistogram.java | 2 +- .../randomforest/data/impurity/MSEHistogram.java | 2 +- .../data/impurity/basic/CountersHistogram.java | 2 +- .../apache/ignite/ml/util/MLSandboxDatasets.java | 2 +- .../org/apache/ignite/ml/util/SandboxMLCache.java | 10 +- .../primitives/scalar/RandomProducer.java | 2 +- .../scalar/RandomProducerWithGenerator.java | 2 +- .../primitives/scalar/UniformRandomProducer.java | 10 +- .../generators/primitives/scalar/package-info.java | 2 +- .../vector/ParametricVectorGenerator.java | 2 +- .../primitives/vector/VectorGenerator.java | 4 +- .../vector/VectorGeneratorPrimitives.java | 8 +- .../primitives/vector/VectorGeneratorsFamily.java | 4 +- .../generators/primitives/vector/package-info.java | 2 +- .../standard/GaussianMixtureDataStream.java | 2 +- .../util/generators/standard/RingsDataStream.java | 4 +- .../apache/ignite/ml/util/genetic/Chromosome.java | 2 +- .../apache/ignite/ml/util/genetic/Population.java | 8 +- .../test/java/org/apache/ignite/ml/TestUtils.java | 3 +- .../ignite/ml/clustering/KMeansTrainerTest.java | 2 +- .../ml/clustering/gmm/GmmPartitionDataTest.java | 1 + .../ignite/ml/clustering/gmm/GmmTrainerTest.java | 24 +- .../apache/ignite/ml/common/CollectionsTest.java | 2 +- .../apache/ignite/ml/common/KeepBinaryTest.java | 6 +- .../org/apache/ignite/ml/common/TrainerTest.java | 3 +- .../ignite/ml/composition/bagging/BaggingTest.java | 18 +- .../ml/composition/boosting/GDBTrainerTest.java | 2 +- .../convergence/ConvergenceCheckerTest.java | 2 +- .../WeightedPredictionsAggregatorTest.java | 17 +- .../dataset/feature/extractor/VectorizerTest.java | 2 +- .../impl/cache/CacheBasedDatasetBuilderTest.java | 2 +- .../impl/cache/util/PartitionDataStorageTest.java | 2 +- .../ml/dataset/primitive/DatasetWrapperTest.java | 12 +- .../ml/environment/LearningEnvironmentTest.java | 2 +- .../deploy/DeployingContextImplTest.java | 2 +- .../ml/environment/deploy/MLDeployingTest.java | 30 +- .../ml/genetic/GAGridCalculateFitnessTest.java | 18 +- .../ml/genetic/GAGridInitializePopulationTest.java | 26 +- .../ignite/ml/genetic/PasswordFitnessFunction.java | 6 +- .../ignite/ml/knn/ANNClassificationTest.java | 2 +- .../apache/ignite/ml/knn/LabeledDatasetHelper.java | 2 +- .../primitives/matrix/MatrixAttributeTest.java | 9 +- .../primitives/matrix/MatrixBaseStorageTest.java | 2 +- .../primitives/matrix/MatrixStorageFixtures.java | 6 +- .../matrix/MatrixViewConstructorTest.java | 1 - .../math/primitives/vector/AbstractVectorTest.java | 12 +- .../primitives/vector/VectorAttributesTest.java | 13 +- .../primitives/vector/VectorBaseStorageTest.java | 2 +- .../vector/VectorImplementationsFixtures.java | 14 +- .../vector/storage/AbstractStorageTest.java | 13 +- .../vector/storage/DenseVectorStorageTest.java | 1 - .../vector/storage/SparseVectorStorageTest.java | 4 +- .../ml/math/stat/DistributionMixtureTest.java | 9 +- .../ignite/ml/multiclass/OneVsRestTrainerTest.java | 2 +- .../compound/CompoundNaiveBayesModelTest.java | 21 +- .../compound/CompoundNaiveBayesTest.java | 9 +- .../compound/CompoundNaiveBayesTrainerTest.java | 9 +- .../apache/ignite/ml/naivebayes/compound/Data.java | 3 +- .../discrete/DiscreteNaiveBayesModelTest.java | 1 - .../discrete/DiscreteNaiveBayesTest.java | 7 +- .../discrete/DiscreteNaiveBayesTrainerTest.java | 20 +- .../gaussian/GaussianNaiveBayesModelTest.java | 1 - .../gaussian/GaussianNaiveBayesTrainerTest.java | 29 +- .../test/java/org/apache/ignite/ml/nn/MLPTest.java | 6 +- .../preprocessing/encoding/EncoderTrainerTest.java | 6 +- .../encoding/OneHotEncoderPreprocessorTest.java | 2 +- .../standardscaling/StandardScalerTrainerTest.java | 4 +- .../logistic/LogisticRegressionSGDTrainerTest.java | 2 +- .../ml/selection/cv/CrossValidationTest.java | 8 +- .../BinaryClassificationEvaluatorTest.java | 4 +- .../scoring/evaluator/RegressionEvaluatorTest.java | 6 +- ...ficationPointwiseMetricStatsAggregatorTest.java | 23 +- .../RegressionMetricStatsAggregatorTest.java | 16 +- .../BinaryClassificationEvaluationContextTest.java | 48 +- .../metric/regression/RegressionMetricsTest.java | 6 +- .../ignite/ml/structures/DatasetStructureTest.java | 5 +- .../ignite/ml/structures/LabeledVectorSetTest.java | 10 +- .../apache/ignite/ml/svm/SVMBinaryTrainerTest.java | 2 +- .../ml/tree/randomforest/data/TreeNodeTest.java | 4 +- .../DataStreamGeneratorFillCacheTest.java | 14 +- .../util/generators/DataStreamGeneratorTest.java | 30 +- .../scalar/UniformRandomProducerTest.java | 5 +- .../primitives/vector/VectorGeneratorTest.java | 2 +- .../vector/VectorGeneratorsFamilyTest.java | 4 +- modules/ml/tensorflow-model-parser/pom.xml | 2 +- modules/ml/xgboost-model-parser/pom.xml | 2 +- modules/mqtt/pom.xml | 2 +- modules/opencensus/pom.xml | 2 +- modules/osgi-karaf/pom.xml | 2 +- modules/osgi-paxlogging/pom.xml | 2 +- modules/osgi/pom.xml | 2 +- modules/platforms/cpp/binary/configure.ac | 2 +- modules/platforms/cpp/common/configure.ac | 2 +- modules/platforms/cpp/configure.ac | 2 +- modules/platforms/cpp/configure.acrel | 2 +- modules/platforms/cpp/core-test/configure.ac | 2 +- modules/platforms/cpp/core/configure.ac | 2 +- modules/platforms/cpp/examples/configure.ac | 2 +- modules/platforms/cpp/ignite/configure.ac | 2 +- modules/platforms/cpp/jni/configure.ac | 2 +- modules/platforms/cpp/network/configure.ac | 2 +- modules/platforms/cpp/odbc/configure.ac | 2 +- .../cpp/odbc/install/ignite-odbc-amd64.wxs | 2 +- .../platforms/cpp/odbc/install/ignite-odbc-x86.wxs | 2 +- .../platforms/cpp/thin-client-test/configure.ac | 2 +- .../ExpiryCacheHolderTest.cs | 7 - .../Properties/AssemblyInfo.cs | 6 +- .../Apache.Ignite.AspNet.csproj | 3 +- .../dotnet/Apache.Ignite.AspNet/Package-Info.cs | 26 - .../Properties/AssemblyInfo.cs | 6 +- .../Properties/AssemblyInfo.cs | 6 +- .../Apache.Ignite.Core.Tests.DotNetCore.csproj | 1 + .../Properties/AssemblyInfo.cs | 4 +- .../Properties/AssemblyInfo.cs | 6 +- .../Properties/AssemblyInfo.cs | 6 +- .../Apache.Ignite.Core.Tests.csproj | 1 + .../ApiParity/ParityTest.cs | 2 +- .../Binary/BinaryBuilderSelfTest.cs | 70 + .../Binary/BinaryDynamicRegistrationTest.cs | 2 +- .../Cache/CacheAbstractTest.cs | 2 +- .../Cache/CacheTestAsyncWrapper.cs | 17 +- .../Cache/DataRegionMetricsTest.cs | 1 - .../Cache/DataStorageMetricsTest.cs | 1 - .../Client/Cache/BinaryBuilderTest.cs | 21 +- .../Client/Cache/CacheClientAsyncWrapper.cs | 7 + .../Client/Cache/CacheTest.cs | 167 +- .../Client/Cache/CacheTestKeepBinary.cs | 2 +- .../Client/Cache/ClientCacheConfigurationTest.cs | 3 - .../Client/Cache/CreateCacheTest.cs | 34 + .../Client/ClientTestBase.cs | 12 +- .../Client/Cluster/ClientClusterTests.cs | 221 ++ .../Deployment/PeerAssemblyLoadingTest.cs | 2 +- .../Apache.Ignite.Core.Tests/Examples/PathUtil.cs | 2 +- .../IgniteConfigurationTest.cs | 2 +- .../Apache.Ignite.Core.Tests/IgniteManagerTest.cs | 2 +- .../Log/DefaultLoggerTest.cs | 2 +- .../Process/IgniteProcess.cs | 2 +- .../Properties/AssemblyInfo.cs | 6 +- .../Apache.Ignite.Core.Tests/TestUtils.Windows.cs | 1 - .../Apache.Ignite.Core/Apache.Ignite.Core.csproj | 39 +- .../Binary/IBinaryObjectBuilder.cs | 14 + .../Apache.Ignite.Core/Binary/Package-Info.cs | 26 - .../Cache/Affinity/Package-Info.cs | 26 - .../Cache/Affinity/Rendezvous/Package-Info.cs | 26 - .../Cache/Configuration/Package-Info.cs | 26 - .../Apache.Ignite.Core/Cache/Event/Package-Info.cs | 26 - .../Cache/Eviction/Package-Info.cs | 26 - .../Cache/Expiry/ExpiryPolicy.cs | 2 +- .../Cache/Expiry/Package-Info.cs | 26 - .../dotnet/Apache.Ignite.Core/Cache/ICache.cs | 17 +- .../Apache.Ignite.Core/Cache/Package-Info.cs | 26 - .../Cache/Query/Continuous/Package-Info.cs | 26 - .../Apache.Ignite.Core/Cache/Query/Package-Info.cs | 26 - .../Apache.Ignite.Core/Cache/Store/Package-Info.cs | 26 - .../Client/Cache/CacheClientConfiguration.cs | 10 + .../Client/Cache/ICacheClient.cs | 12 + .../Apache.Ignite.Core/Client/IClientCluster.cs | 74 + .../Apache.Ignite.Core/Client/IIgniteClient.cs | 6 + .../Apache.Ignite.Core/Cluster/Package-Info.cs | 26 - .../Apache.Ignite.Core/Common/Package-Info.cs | 26 - .../Communication/Package-Info.cs | 26 - .../Communication/Tcp/Package-Info.cs | 26 - .../Apache.Ignite.Core/Compute/Package-Info.cs | 26 - .../Configuration/Package-Info.cs | 26 - .../DataStructures/Configuration/Package-Info.cs | 26 - .../DataStructures/Package-Info.cs | 26 - .../Apache.Ignite.Core/Datastream/Package-Info.cs | 26 - .../Apache.Ignite.Core/Discovery/Package-Info.cs | 26 - .../Discovery/Tcp/Multicast/Package-Info.cs | 26 - .../Discovery/Tcp/Package-Info.cs | 26 - .../Discovery/Tcp/Static/Package-Info.cs | 26 - .../Encryption/Keystore/Package-Info.cs | 26 - .../Apache.Ignite.Core/Encryption/Package-Info.cs | 26 - .../Apache.Ignite.Core/Events/Package-Info.cs | 26 - .../Impl/Binary/BinaryObjectBuilder.cs | 15 +- .../Apache.Ignite.Core/Impl/Cache/CacheImpl.cs | 51 +- .../Apache.Ignite.Core/Impl/Cache/CacheOp.cs | 3 +- .../Impl/Client/Cache/CacheClient.cs | 61 +- .../Cache/ClientCacheConfigurationSerializer.cs | 14 +- .../Apache.Ignite.Core/Impl/Client/ClientOp.cs | 8 +- .../Apache.Ignite.Core/Impl/Client/ClientSocket.cs | 10 +- .../Impl/Client/Cluster/ClientCluster.cs | 131 ++ .../Apache.Ignite.Core/Impl/Client/IgniteClient.cs | 7 + .../dotnet/Apache.Ignite.Core/Impl/Ignite.cs | 2 +- .../Apache.Ignite.Core/Interop/Package-Info.cs | 26 - .../Apache.Ignite.Core/Lifecycle/Package-Info.cs | 26 - .../Apache.Ignite.Core/Messaging/Package-Info.cs | 26 - .../dotnet/Apache.Ignite.Core/Package-Info.cs | 36 - .../PersistentStore/Package-Info.cs | 26 - .../Apache.Ignite.Core/Properties/AssemblyInfo.cs | 6 +- .../Apache.Ignite.Core/Resource/Package-Info.cs | 26 - .../Apache.Ignite.Core/Services/Package-Info.cs | 26 - .../Transactions/Package-Info.cs | 26 - .../Properties/AssemblyInfo.cs | 6 +- .../Apache.Ignite.EntityFramework.csproj | 4 +- .../Properties/AssemblyInfo.cs | 6 +- .../Apache.Ignite.Linq/Apache.Ignite.Linq.csproj | 3 +- .../dotnet/Apache.Ignite.Linq/Package-Info.cs | 26 - .../Apache.Ignite.Linq/Properties/AssemblyInfo.cs | 6 +- .../Apache.Ignite.Log4Net.csproj | 2 +- .../Properties/AssemblyInfo.cs | 6 +- .../Apache.Ignite.NLog/Apache.Ignite.NLog.csproj | 2 +- .../Apache.Ignite.NLog/Properties/AssemblyInfo.cs | 6 +- modules/platforms/dotnet/Apache.Ignite.dxg | 2387 -------------------- .../Apache.Ignite/Properties/AssemblyInfo.cs | 6 +- modules/platforms/dotnet/docfx/README.txt | 8 +- modules/platforms/dotnet/header.html | 27 - modules/platforms/dotnet/release/Program.cs | 100 + modules/platforms/dotnet/release/verify-nuget.ps1 | 91 + modules/rest-http/pom.xml | 2 +- modules/rocketmq/pom.xml | 2 +- modules/scalar-2.10/pom.xml | 2 +- modules/scalar/pom.xml | 2 +- modules/schedule/pom.xml | 2 +- modules/slf4j/pom.xml | 2 +- modules/{spark => spark-2.4}/README.txt | 0 .../licenses/apache-2.0.txt | 0 modules/{spark => spark-2.4}/pom.xml | 18 +- ...org.apache.spark.sql.sources.DataSourceRegister | 0 .../org/apache/ignite/spark/IgniteContext.scala | 237 ++ .../ignite/spark/IgniteDataFrameSettings.scala | 0 .../scala/org/apache/ignite/spark/IgniteRDD.scala | 0 .../apache/ignite/spark/JavaIgniteContext.scala | 0 .../org/apache/ignite/spark/JavaIgniteRDD.scala | 0 .../ignite/spark/impl/IgniteAbstractRDD.scala | 0 .../spark/impl/IgniteDataFramePartition.scala | 0 .../apache/ignite/spark/impl/IgnitePartition.scala | 0 .../ignite/spark/impl/IgniteQueryIterator.scala | 0 .../ignite/spark/impl/IgniteRelationProvider.scala | 0 .../spark/impl/IgniteSQLAccumulatorRelation.scala | 0 .../ignite/spark/impl/IgniteSQLDataFrameRDD.scala | 0 .../ignite/spark/impl/IgniteSQLRelation.scala | 0 .../apache/ignite/spark/impl/IgniteSqlRDD.scala | 0 .../org/apache/ignite/spark/impl/QueryHelper.scala | 0 .../org/apache/ignite/spark/impl/QueryUtils.scala | 0 .../impl/optimization/AggregateExpressions.scala | 0 .../impl/optimization/ConditionExpressions.scala | 0 .../spark/impl/optimization/DateExpressions.scala | 0 .../impl/optimization/IgniteQueryContext.scala | 0 .../spark/impl/optimization/MathExpressions.scala | 0 .../impl/optimization/SimpleExpressions.scala | 203 ++ .../impl/optimization/StringExpressions.scala | 0 .../impl/optimization/SupportedExpressions.scala | 0 .../impl/optimization/SystemExpressions.scala | 0 .../accumulator/JoinSQLAccumulator.scala | 226 ++ .../accumulator/QueryAccumulator.scala | 0 .../accumulator/SelectAccumulator.scala | 0 .../accumulator/SingleTableSQLAccumulator.scala | 0 .../accumulator/UnionSQLAccumulator.scala | 0 .../ignite/spark/impl/optimization/package.scala | 0 .../org/apache/ignite/spark/impl/package.scala | 0 .../spark/sql/ignite/IgniteExternalCatalog.scala | 341 +++ .../spark/sql/ignite/IgniteOptimization.scala | 441 ++++ .../spark/sql/ignite/IgniteSharedState.scala | 45 + .../spark/sql/ignite/IgniteSparkSession.scala | 0 .../spark/JavaEmbeddedIgniteRDDSelfTest.java | 0 ...avaEmbeddedIgniteRDDWithLocalStoreSelfTest.java | 0 .../spark/JavaStandaloneIgniteRDDSelfTest.java | 0 .../ignite/testsuites/IgniteRDDTestSuite.java | 0 .../src/test/resources/cities.json | 0 .../src/test/resources/cities_non_unique.json | 0 .../src/test/resources/ignite-spark-config.xml | 0 .../ignite/spark/AbstractDataFrameSpec.scala | 241 ++ .../scala/org/apache/ignite/spark/Entity.scala | 0 .../ignite/spark/EntityTestAllTypeFields.scala | 0 .../apache/ignite/spark/IgniteCatalogSpec.scala | 229 ++ .../ignite/spark/IgniteDataFrameSchemaSpec.scala | 0 .../apache/ignite/spark/IgniteDataFrameSuite.scala | 0 .../spark/IgniteDataFrameWrongConfigSpec.scala | 0 .../IgniteOptimizationAggregationFuncSpec.scala | 189 ++ .../spark/IgniteOptimizationDateFuncSpec.scala | 0 .../IgniteOptimizationDisableEnableSpec.scala | 0 .../ignite/spark/IgniteOptimizationJoinSpec.scala | 539 +++++ .../spark/IgniteOptimizationMathFuncSpec.scala | 0 .../ignite/spark/IgniteOptimizationSpec.scala | 362 +++ .../spark/IgniteOptimizationStringFuncSpec.scala | 0 .../spark/IgniteOptimizationSystemFuncSpec.scala | 147 ++ .../org/apache/ignite/spark/IgniteRDDSpec.scala | 0 .../IgniteSQLDataFrameIgniteSessionWriteSpec.scala | 109 + .../ignite/spark/IgniteSQLDataFrameSpec.scala | 0 .../ignite/spark/IgniteSQLDataFrameWriteSpec.scala | 388 ++++ .../spark/sql/ignite/IgniteSparkSessionSpec.scala | 79 + modules/spark/pom.xml | 2 +- modules/spring-data-2.0/pom.xml | 2 +- modules/spring-data/pom.xml | 2 +- modules/spring/pom.xml | 2 +- modules/sqlline/bin/sqlline.sh | 13 +- modules/sqlline/pom.xml | 2 +- modules/ssh/pom.xml | 2 +- modules/storm/pom.xml | 2 +- modules/tensorflow/pom.xml | 2 +- modules/tools/pom.xml | 2 +- modules/twitter/pom.xml | 2 +- modules/urideploy/pom.xml | 2 +- modules/visor-console-2.10/pom.xml | 2 +- modules/visor-console/pom.xml | 2 +- modules/visor-plugins/pom.xml | 2 +- modules/web-console/pom.xml | 2 +- modules/web-console/web-agent/pom.xml | 2 +- modules/web/ignite-appserver-test/pom.xml | 2 +- modules/web/ignite-websphere-test/pom.xml | 2 +- modules/web/pom.xml | 2 +- .../config/benchmark-native-sql-inline.properties | 85 + modules/yardstick/pom.xml | 2 +- .../apache/ignite/yardstick/jdbc/JdbcUtils.java | 77 +- .../jdbc/NativeSqlMixedDateInlineBenchmark.java | 139 ++ modules/yarn/pom.xml | 2 +- modules/yarn/src/main/resources/ignite.properties | 2 +- modules/zeromq/pom.xml | 2 +- modules/zookeeper/pom.xml | 2 +- .../ZookeeperDiscoveryClientReconnectTest.java | 2 +- ...perDiscoveryTopologyChangeAndReconnectTest.java | 45 +- packaging/package.sh | 13 +- parent/pom.xml | 5 +- pom.xml | 13 +- 865 files changed, 21129 insertions(+), 10034 deletions(-) create mode 100644 examples/src/main/java/org/apache/ignite/examples/ml/inference/h2o/H2OMojoModelParserExample.java copy examples/src/main/java/org/apache/ignite/examples/ml/{naivebayes => inference/h2o}/package-info.java (86%) rename examples/src/main/resources/datasets/{titanik_test.csv => titanic_test.csv} (100%) rename examples/src/main/resources/datasets/{titanik_train.csv => titanic_train.csv} (100%) create mode 100644 examples/src/main/resources/models/h2o/agaricus-gbm-mojo.zip create mode 100644 examples/src/main/spark/org/apache/ignite/examples/spark/IgniteDataFrameJoinExample.scala create mode 100644 examples/src/main/spark/org/apache/ignite/examples/spark/JavaIgniteDataFrameJoinExample.java create mode 100644 modules/benchmarks/src/main/java/org/apache/ignite/internal/benchmarks/jmh/misc/JmhPartitionUpdateCounterBenchmark.java create mode 100644 modules/core/src/main/java/org/apache/ignite/internal/client/thin/ClientCacheAffinityContext.java create mode 100644 modules/core/src/main/java/org/apache/ignite/internal/client/thin/ClientCacheAffinityMapping.java rename modules/core/src/main/java/org/apache/ignite/internal/{client/thin/Result.java => managers/communication/TransmissionCancelledException.java} (54%) create mode 100644 modules/core/src/main/java/org/apache/ignite/internal/managers/systemview/ScanQuerySystemView.java create mode 100644 modules/core/src/main/java/org/apache/ignite/internal/managers/systemview/walker/ScanQueryViewWalker.java create mode 100644 modules/core/src/main/java/org/apache/ignite/internal/managers/systemview/walker/SqlQueryHistoryViewWalker.java create mode 100644 modules/core/src/main/java/org/apache/ignite/internal/managers/systemview/walker/SqlQueryViewWalker.java create mode 100644 modules/core/src/main/java/org/apache/ignite/internal/managers/systemview/walker/StripedExecutorTaskViewWalker.java delete mode 100644 modules/core/src/main/java/org/apache/ignite/internal/pagemem/wal/record/delta/MetaPageUpdatePartitionDataRecordV3.java delete mode 100644 modules/core/src/main/java/org/apache/ignite/internal/processors/cache/TombstoneCacheObject.java create mode 100644 modules/core/src/main/java/org/apache/ignite/internal/processors/platform/client/cluster/ClientClusterChangeStateRequest.java create mode 100644 modules/core/src/main/java/org/apache/ignite/internal/processors/platform/client/cluster/ClientClusterIsActiveRequest.java create mode 100644 modules/core/src/main/java/org/apache/ignite/internal/processors/platform/client/cluster/ClientClusterWalChangeStateRequest.java copy modules/{ml/src/main/java/org/apache/ignite/ml/genetic/parameter/ChromosomeCriteria.java => core/src/main/java/org/apache/ignite/internal/processors/platform/client/cluster/ClientClusterWalChangeStateResponse.java} (50%) create mode 100644 modules/core/src/main/java/org/apache/ignite/internal/processors/platform/client/cluster/ClientClusterWalGetStateRequest.java rename modules/core/src/main/java/org/apache/ignite/internal/processors/query/{QueryHistoryMetrics.java => QueryHistory.java} (87%) rename modules/core/src/main/java/org/apache/ignite/internal/processors/query/{QueryHistoryMetricsKey.java => QueryHistoryKey.java} (92%) create mode 100644 modules/core/src/main/java/org/apache/ignite/internal/processors/resource/GridResourceProxiedIgniteInjector.java create mode 100644 modules/core/src/main/java/org/apache/ignite/internal/processors/security/sandbox/AccessControllerSandbox.java create mode 100644 modules/core/src/main/java/org/apache/ignite/internal/processors/security/sandbox/IgniteDomainCombiner.java create mode 100644 modules/core/src/main/java/org/apache/ignite/internal/processors/security/sandbox/IgniteSandbox.java copy modules/{ml/spark-model-parser/src/main/java/org/apache/ignite/ml/sparkmodelparser/UnsupportedSparkModelException.java => core/src/main/java/org/apache/ignite/internal/processors/security/sandbox/NoOpSandbox.java} (66%) create mode 100644 modules/core/src/main/java/org/apache/ignite/internal/processors/security/sandbox/SandboxIgniteComponentProxy.java create mode 100644 modules/core/src/main/java/org/apache/ignite/spi/systemview/view/ScanQueryView.java create mode 100644 modules/core/src/main/java/org/apache/ignite/spi/systemview/view/SqlQueryHistoryView.java create mode 100644 modules/core/src/main/java/org/apache/ignite/spi/systemview/view/SqlQueryView.java create mode 100644 modules/core/src/main/java/org/apache/ignite/spi/systemview/view/StripedExecutorTaskView.java create mode 100644 modules/core/src/test/java/org/apache/ignite/cache/RemoveAllDeadlockTest.java create mode 100644 modules/core/src/test/java/org/apache/ignite/internal/client/thin/ThinClientAbstractAffinityAwarenessTest.java create mode 100644 modules/core/src/test/java/org/apache/ignite/internal/client/thin/ThinClientAffinityAwarenessStableTopologyTest.java create mode 100644 modules/core/src/test/java/org/apache/ignite/internal/client/thin/ThinClientAffinityAwarenessUnstableTopologyTest.java create mode 100644 modules/core/src/test/java/org/apache/ignite/internal/processors/cache/ClientSlowDiscoveryAbstractTest.java rename modules/core/src/test/java/org/apache/ignite/internal/processors/cache/{ClientDelayedJoinTest.java => ClientSlowDiscoveryTopologyChangeTest.java} (56%) create mode 100644 modules/core/src/test/java/org/apache/ignite/internal/processors/cache/ClientSlowDiscoveryTransactionRemapTest.java create mode 100644 modules/core/src/test/java/org/apache/ignite/internal/processors/cache/GridCacheProcessorActiveTxTest.java create mode 100644 modules/core/src/test/java/org/apache/ignite/internal/processors/cache/SafeLogTxFinishErrorTest.java delete mode 100644 modules/core/src/test/java/org/apache/ignite/internal/processors/cache/distributed/CacheRemoveWithTombstonesLoadTest.java delete mode 100644 modules/core/src/test/java/org/apache/ignite/internal/processors/cache/distributed/CacheRemoveWithTombstonesTest.java delete mode 100644 modules/core/src/test/java/org/apache/ignite/internal/processors/cache/distributed/dht/topology/CacheRemoveWithTombstonesFailoverTest.java create mode 100644 modules/core/src/test/java/org/apache/ignite/internal/processors/cache/local/GridCacheFastNodeLeftForTransactionTest.java create mode 100644 modules/core/src/test/java/org/apache/ignite/internal/processors/cache/persistence/db/checkpoint/CheckpointStartLoggingTest.java create mode 100644 modules/core/src/test/java/org/apache/ignite/internal/processors/cache/transactions/TxCrossCachePartitionConsistencyTest.java create mode 100644 modules/core/src/test/java/org/apache/ignite/internal/processors/cache/transactions/TxCrossCacheRemoteMultiplePartitionReservationTest.java copy modules/core/src/{main/java/org/apache/ignite/internal/processors/cache/transactions/IgniteTxRemoteEx.java => test/java/org/apache/ignite/internal/processors/cache/transactions/TxPartitionCounterStateConsistencyVolatileRebalanceTest.java} (52%) create mode 100644 modules/core/src/test/java/org/apache/ignite/internal/processors/datastreamer/DataStreamerStopCacheTest.java create mode 100644 modules/core/src/test/java/org/apache/ignite/internal/processors/failure/FailureProcessorLoggingTest.java create mode 100644 modules/core/src/test/java/org/apache/ignite/internal/processors/security/compute/closure/ComputeTaskCancelRemoteSecurityContextCheckTest.java create mode 100644 modules/core/src/test/java/org/apache/ignite/internal/processors/security/sandbox/AbstractSandboxTest.java create mode 100644 modules/core/src/test/java/org/apache/ignite/internal/processors/security/sandbox/CacheSandboxTest.java create mode 100644 modules/core/src/test/java/org/apache/ignite/internal/processors/security/sandbox/ComputeSandboxTest.java create mode 100644 modules/core/src/test/java/org/apache/ignite/internal/processors/security/sandbox/DataStreamerSandboxTest.java create mode 100644 modules/core/src/test/java/org/apache/ignite/internal/processors/security/sandbox/DoPrivilegedOnRemoteNodeTest.java create mode 100644 modules/core/src/test/java/org/apache/ignite/internal/processors/security/sandbox/IgniteOperationsInsideSandboxTest.java create mode 100644 modules/core/src/test/java/org/apache/ignite/internal/processors/security/sandbox/SecuritySubjectPermissionsTest.java delete mode 100644 modules/indexing/src/main/java/org/apache/ignite/internal/processors/query/h2/sys/view/SqlSystemViewQueryHistoryMetrics.java delete mode 100644 modules/indexing/src/main/java/org/apache/ignite/internal/processors/query/h2/sys/view/SqlSystemViewRunningQueries.java create mode 100644 modules/indexing/src/test/java/org/apache/ignite/internal/processors/cache/CacheGroupMetricsWithIndexBuildFailTest.java create mode 100644 modules/indexing/src/test/java/org/apache/ignite/internal/processors/cache/distributed/near/IgniteCacheDistributedQueryDefaultTimeoutSelfTest.java create mode 100644 modules/indexing/src/test/java/org/apache/ignite/internal/processors/cache/index/IndexMetricsTest.java create mode 100644 modules/indexing/src/test/java/org/apache/ignite/internal/processors/cache/local/IgniteCacheLocalQueryDefaultTimeoutSelfTest.java copy modules/ml/{xgboost-model-parser => h2o-model-parser}/pom.xml (90%) create mode 100644 modules/ml/h2o-model-parser/src/main/java/org/apache/ignite/ml/h2o/H2OMojoModel.java create mode 100644 modules/ml/h2o-model-parser/src/main/java/org/apache/ignite/ml/h2o/H2OMojoModelParser.java copy modules/ml/{src/main/java/org/apache/ignite/ml/composition/combinators => h2o-model-parser/src/main/java/org/apache/ignite/ml/h2o}/package-info.java (88%) create mode 100644 modules/ml/h2o-model-parser/src/test/java/org/apache/ignite/ml/h2o/H2OMojoParserTest.java copy examples/src/main/java/org/apache/ignite/examples/ml/preprocessing/package-info.java => modules/ml/h2o-model-parser/src/test/java/org/apache/ignite/ml/h2o/H2OMojoTestSuite.java (75%) create mode 100644 modules/ml/h2o-model-parser/src/test/resources/mojos/gbm_prostate.zip delete mode 100644 modules/platforms/dotnet/Apache.Ignite.AspNet/Package-Info.cs create mode 100644 modules/platforms/dotnet/Apache.Ignite.Core.Tests/Client/Cluster/ClientClusterTests.cs delete mode 100644 modules/platforms/dotnet/Apache.Ignite.Core/Binary/Package-Info.cs delete mode 100644 modules/platforms/dotnet/Apache.Ignite.Core/Cache/Affinity/Package-Info.cs delete mode 100644 modules/platforms/dotnet/Apache.Ignite.Core/Cache/Affinity/Rendezvous/Package-Info.cs delete mode 100644 modules/platforms/dotnet/Apache.Ignite.Core/Cache/Configuration/Package-Info.cs delete mode 100644 modules/platforms/dotnet/Apache.Ignite.Core/Cache/Event/Package-Info.cs delete mode 100644 modules/platforms/dotnet/Apache.Ignite.Core/Cache/Eviction/Package-Info.cs delete mode 100644 modules/platforms/dotnet/Apache.Ignite.Core/Cache/Expiry/Package-Info.cs delete mode 100644 modules/platforms/dotnet/Apache.Ignite.Core/Cache/Package-Info.cs delete mode 100644 modules/platforms/dotnet/Apache.Ignite.Core/Cache/Query/Continuous/Package-Info.cs delete mode 100644 modules/platforms/dotnet/Apache.Ignite.Core/Cache/Query/Package-Info.cs delete mode 100644 modules/platforms/dotnet/Apache.Ignite.Core/Cache/Store/Package-Info.cs create mode 100644 modules/platforms/dotnet/Apache.Ignite.Core/Client/IClientCluster.cs delete mode 100644 modules/platforms/dotnet/Apache.Ignite.Core/Cluster/Package-Info.cs delete mode 100644 modules/platforms/dotnet/Apache.Ignite.Core/Common/Package-Info.cs delete mode 100644 modules/platforms/dotnet/Apache.Ignite.Core/Communication/Package-Info.cs delete mode 100644 modules/platforms/dotnet/Apache.Ignite.Core/Communication/Tcp/Package-Info.cs delete mode 100644 modules/platforms/dotnet/Apache.Ignite.Core/Compute/Package-Info.cs delete mode 100644 modules/platforms/dotnet/Apache.Ignite.Core/Configuration/Package-Info.cs delete mode 100644 modules/platforms/dotnet/Apache.Ignite.Core/DataStructures/Configuration/Package-Info.cs delete mode 100644 modules/platforms/dotnet/Apache.Ignite.Core/DataStructures/Package-Info.cs delete mode 100644 modules/platforms/dotnet/Apache.Ignite.Core/Datastream/Package-Info.cs delete mode 100644 modules/platforms/dotnet/Apache.Ignite.Core/Discovery/Package-Info.cs delete mode 100644 modules/platforms/dotnet/Apache.Ignite.Core/Discovery/Tcp/Multicast/Package-Info.cs delete mode 100644 modules/platforms/dotnet/Apache.Ignite.Core/Discovery/Tcp/Package-Info.cs delete mode 100644 modules/platforms/dotnet/Apache.Ignite.Core/Discovery/Tcp/Static/Package-Info.cs delete mode 100644 modules/platforms/dotnet/Apache.Ignite.Core/Encryption/Keystore/Package-Info.cs delete mode 100644 modules/platforms/dotnet/Apache.Ignite.Core/Encryption/Package-Info.cs delete mode 100644 modules/platforms/dotnet/Apache.Ignite.Core/Events/Package-Info.cs create mode 100644 modules/platforms/dotnet/Apache.Ignite.Core/Impl/Client/Cluster/ClientCluster.cs delete mode 100644 modules/platforms/dotnet/Apache.Ignite.Core/Interop/Package-Info.cs delete mode 100644 modules/platforms/dotnet/Apache.Ignite.Core/Lifecycle/Package-Info.cs delete mode 100644 modules/platforms/dotnet/Apache.Ignite.Core/Messaging/Package-Info.cs delete mode 100644 modules/platforms/dotnet/Apache.Ignite.Core/Package-Info.cs delete mode 100644 modules/platforms/dotnet/Apache.Ignite.Core/PersistentStore/Package-Info.cs delete mode 100644 modules/platforms/dotnet/Apache.Ignite.Core/Resource/Package-Info.cs delete mode 100644 modules/platforms/dotnet/Apache.Ignite.Core/Services/Package-Info.cs delete mode 100644 modules/platforms/dotnet/Apache.Ignite.Core/Transactions/Package-Info.cs delete mode 100644 modules/platforms/dotnet/Apache.Ignite.Linq/Package-Info.cs delete mode 100644 modules/platforms/dotnet/Apache.Ignite.dxg delete mode 100644 modules/platforms/dotnet/header.html create mode 100644 modules/platforms/dotnet/release/Program.cs create mode 100644 modules/platforms/dotnet/release/verify-nuget.ps1 copy modules/{spark => spark-2.4}/README.txt (100%) copy modules/{zookeeper => spark-2.4}/licenses/apache-2.0.txt (100%) copy modules/{spark => spark-2.4}/pom.xml (93%) copy modules/{spark => spark-2.4}/src/main/resources/META-INF/services/org.apache.spark.sql.sources.DataSourceRegister (100%) create mode 100644 modules/spark-2.4/src/main/scala/org/apache/ignite/spark/IgniteContext.scala copy modules/{spark => spark-2.4}/src/main/scala/org/apache/ignite/spark/IgniteDataFrameSettings.scala (100%) copy modules/{spark => spark-2.4}/src/main/scala/org/apache/ignite/spark/IgniteRDD.scala (100%) copy modules/{spark => spark-2.4}/src/main/scala/org/apache/ignite/spark/JavaIgniteContext.scala (100%) copy modules/{spark => spark-2.4}/src/main/scala/org/apache/ignite/spark/JavaIgniteRDD.scala (100%) copy modules/{spark => spark-2.4}/src/main/scala/org/apache/ignite/spark/impl/IgniteAbstractRDD.scala (100%) copy modules/{spark => spark-2.4}/src/main/scala/org/apache/ignite/spark/impl/IgniteDataFramePartition.scala (100%) copy modules/{spark => spark-2.4}/src/main/scala/org/apache/ignite/spark/impl/IgnitePartition.scala (100%) copy modules/{spark => spark-2.4}/src/main/scala/org/apache/ignite/spark/impl/IgniteQueryIterator.scala (100%) copy modules/{spark => spark-2.4}/src/main/scala/org/apache/ignite/spark/impl/IgniteRelationProvider.scala (100%) copy modules/{spark => spark-2.4}/src/main/scala/org/apache/ignite/spark/impl/IgniteSQLAccumulatorRelation.scala (100%) copy modules/{spark => spark-2.4}/src/main/scala/org/apache/ignite/spark/impl/IgniteSQLDataFrameRDD.scala (100%) copy modules/{spark => spark-2.4}/src/main/scala/org/apache/ignite/spark/impl/IgniteSQLRelation.scala (100%) copy modules/{spark => spark-2.4}/src/main/scala/org/apache/ignite/spark/impl/IgniteSqlRDD.scala (100%) copy modules/{spark => spark-2.4}/src/main/scala/org/apache/ignite/spark/impl/QueryHelper.scala (100%) copy modules/{spark => spark-2.4}/src/main/scala/org/apache/ignite/spark/impl/QueryUtils.scala (100%) copy modules/{spark => spark-2.4}/src/main/scala/org/apache/ignite/spark/impl/optimization/AggregateExpressions.scala (100%) copy modules/{spark => spark-2.4}/src/main/scala/org/apache/ignite/spark/impl/optimization/ConditionExpressions.scala (100%) copy modules/{spark => spark-2.4}/src/main/scala/org/apache/ignite/spark/impl/optimization/DateExpressions.scala (100%) copy modules/{spark => spark-2.4}/src/main/scala/org/apache/ignite/spark/impl/optimization/IgniteQueryContext.scala (100%) copy modules/{spark => spark-2.4}/src/main/scala/org/apache/ignite/spark/impl/optimization/MathExpressions.scala (100%) create mode 100644 modules/spark-2.4/src/main/scala/org/apache/ignite/spark/impl/optimization/SimpleExpressions.scala copy modules/{spark => spark-2.4}/src/main/scala/org/apache/ignite/spark/impl/optimization/StringExpressions.scala (100%) copy modules/{spark => spark-2.4}/src/main/scala/org/apache/ignite/spark/impl/optimization/SupportedExpressions.scala (100%) copy modules/{spark => spark-2.4}/src/main/scala/org/apache/ignite/spark/impl/optimization/SystemExpressions.scala (100%) create mode 100644 modules/spark-2.4/src/main/scala/org/apache/ignite/spark/impl/optimization/accumulator/JoinSQLAccumulator.scala copy modules/{spark => spark-2.4}/src/main/scala/org/apache/ignite/spark/impl/optimization/accumulator/QueryAccumulator.scala (100%) copy modules/{spark => spark-2.4}/src/main/scala/org/apache/ignite/spark/impl/optimization/accumulator/SelectAccumulator.scala (100%) copy modules/{spark => spark-2.4}/src/main/scala/org/apache/ignite/spark/impl/optimization/accumulator/SingleTableSQLAccumulator.scala (100%) copy modules/{spark => spark-2.4}/src/main/scala/org/apache/ignite/spark/impl/optimization/accumulator/UnionSQLAccumulator.scala (100%) copy modules/{spark => spark-2.4}/src/main/scala/org/apache/ignite/spark/impl/optimization/package.scala (100%) copy modules/{spark => spark-2.4}/src/main/scala/org/apache/ignite/spark/impl/package.scala (100%) create mode 100644 modules/spark-2.4/src/main/scala/org/apache/spark/sql/ignite/IgniteExternalCatalog.scala create mode 100644 modules/spark-2.4/src/main/scala/org/apache/spark/sql/ignite/IgniteOptimization.scala create mode 100644 modules/spark-2.4/src/main/scala/org/apache/spark/sql/ignite/IgniteSharedState.scala copy modules/{spark => spark-2.4}/src/main/scala/org/apache/spark/sql/ignite/IgniteSparkSession.scala (100%) copy modules/{spark => spark-2.4}/src/test/java/org/apache/ignite/spark/JavaEmbeddedIgniteRDDSelfTest.java (100%) copy modules/{spark => spark-2.4}/src/test/java/org/apache/ignite/spark/JavaEmbeddedIgniteRDDWithLocalStoreSelfTest.java (100%) copy modules/{spark => spark-2.4}/src/test/java/org/apache/ignite/spark/JavaStandaloneIgniteRDDSelfTest.java (100%) copy modules/{spark => spark-2.4}/src/test/java/org/apache/ignite/testsuites/IgniteRDDTestSuite.java (100%) copy modules/{spark => spark-2.4}/src/test/resources/cities.json (100%) copy modules/{spark => spark-2.4}/src/test/resources/cities_non_unique.json (100%) copy modules/{spark => spark-2.4}/src/test/resources/ignite-spark-config.xml (100%) create mode 100644 modules/spark-2.4/src/test/scala/org/apache/ignite/spark/AbstractDataFrameSpec.scala copy modules/{spark => spark-2.4}/src/test/scala/org/apache/ignite/spark/Entity.scala (100%) copy modules/{spark => spark-2.4}/src/test/scala/org/apache/ignite/spark/EntityTestAllTypeFields.scala (100%) create mode 100644 modules/spark-2.4/src/test/scala/org/apache/ignite/spark/IgniteCatalogSpec.scala copy modules/{spark => spark-2.4}/src/test/scala/org/apache/ignite/spark/IgniteDataFrameSchemaSpec.scala (100%) copy modules/{spark => spark-2.4}/src/test/scala/org/apache/ignite/spark/IgniteDataFrameSuite.scala (100%) copy modules/{spark => spark-2.4}/src/test/scala/org/apache/ignite/spark/IgniteDataFrameWrongConfigSpec.scala (100%) create mode 100644 modules/spark-2.4/src/test/scala/org/apache/ignite/spark/IgniteOptimizationAggregationFuncSpec.scala copy modules/{spark => spark-2.4}/src/test/scala/org/apache/ignite/spark/IgniteOptimizationDateFuncSpec.scala (100%) copy modules/{spark => spark-2.4}/src/test/scala/org/apache/ignite/spark/IgniteOptimizationDisableEnableSpec.scala (100%) create mode 100644 modules/spark-2.4/src/test/scala/org/apache/ignite/spark/IgniteOptimizationJoinSpec.scala copy modules/{spark => spark-2.4}/src/test/scala/org/apache/ignite/spark/IgniteOptimizationMathFuncSpec.scala (100%) create mode 100644 modules/spark-2.4/src/test/scala/org/apache/ignite/spark/IgniteOptimizationSpec.scala copy modules/{spark => spark-2.4}/src/test/scala/org/apache/ignite/spark/IgniteOptimizationStringFuncSpec.scala (100%) create mode 100644 modules/spark-2.4/src/test/scala/org/apache/ignite/spark/IgniteOptimizationSystemFuncSpec.scala copy modules/{spark => spark-2.4}/src/test/scala/org/apache/ignite/spark/IgniteRDDSpec.scala (100%) create mode 100644 modules/spark-2.4/src/test/scala/org/apache/ignite/spark/IgniteSQLDataFrameIgniteSessionWriteSpec.scala copy modules/{spark => spark-2.4}/src/test/scala/org/apache/ignite/spark/IgniteSQLDataFrameSpec.scala (100%) create mode 100644 modules/spark-2.4/src/test/scala/org/apache/ignite/spark/IgniteSQLDataFrameWriteSpec.scala create mode 100644 modules/spark-2.4/src/test/scala/org/apache/spark/sql/ignite/IgniteSparkSessionSpec.scala create mode 100644 modules/yardstick/config/benchmark-native-sql-inline.properties create mode 100644 modules/yardstick/src/main/java/org/apache/ignite/yardstick/jdbc/NativeSqlMixedDateInlineBenchmark.java