ElasticSearch Index/Query

code

docs

tests

Index/Query services backed by ElasticSearch search engine built on top of +Apache Lucene.

Warning

ElasticSearch Index/Query do not support ComplexQueries from the Query API, ie. queries by "example value".

Three modes of operation are supported:

embedded local only filesystem based node ;
managed cluster client ; @@ -76,22 +76,22 @@ with a provided client.

In any case, Lucene hard limits apply. See the Lucene File Format documentation about maximum index size and document count. -Moreover, each field cannot be larger than 32766 bytes in its serialized form.

Table 65. Artifact

Group ID	Artifact ID	Version
org.apache.polygene.extensions	org.apache.polygene.extension.indexing-elasticsearch	3.1.0-SNAPSHOT

Embedded on local file system

Filesy stem based ElasticSearch Index/Query service relies on the FileConfig Library to decide where it stores its +Moreover, each field cannot be larger than 32766 bytes in its serialized form.

Table 72. Artifact

Group ID	Artifact ID	Version
org.apache.polygene.extensions	org.apache.polygene.extension.indexing-elasticsearch	0

Embedded on local file system

Filesystem based ElasticSearch Index/Query service relies on the FileConfig Library to decide where it stores its index data, transaction logs etc…

Assembly is done using the provided Assembler:

new ESFilesystemIndexQueryAssembler()
     .withConfig( configModule, configVisibility )
     .assemble( module );
-

Configuration

Important

By default queries can only traverse Aggregated Associations, if you want to be able to traverse all +

Configuration

Important

By default queries can only traverse Aggregated Associations, if you want to be able to traverse all Associations set the indexNonAggregatedAssociations configuration property to TRUE.

Here are the configuration properties for the filesystem ElasticSearch Index/Query services:

Traceback (most recent call last):
-  File "/Users/paul/.asciidoc/filters/snippet/snippet.py", line 100, in <module>
+  File "/home/niclas/.asciidoc/filters/snippet/snippet.py", line 100, in <module>
     for line in snippet(**configuration(indata)):
-  File "/Users/paul/.asciidoc/filters/snippet/snippet.py", line 51, in snippet
+  File "/home/niclas/.asciidoc/filters/snippet/snippet.py", line 51, in snippet
     sourceFile = open(PATH_PATTERN % locals())
 IOError: [Errno 2] No such file or directory: 'extensions/indexing-elasticsearch/src/main/java/org/apache/polygene/index/elasticsearch/ElasticSearchConfiguration.java'

All configuration properties are defaulted meaning that you can use ElasticSearch Index/Query service without -configuration.

In an ElasticSearch cluster

Assembly

Assembly is done using the provided Assembler:

new ESClusterIndexQueryAssembler()
+configuration.

In an ElasticSearch cluster

Assembly

Assembly is done using the provided Assembler:

new ESClusterIndexQueryAssembler()
     .withConfig( configModule, configVisibility )
     .assemble( module );
-

Configuration

Here are the configuration properties for the clustered ElasticSearch Index/Query service. Note that it inherits the +

Configuration

Here are the configuration properties for the clustered ElasticSearch Index/Query service. Note that it inherits the properties defined in the filesystem configuration, see above.

public interface ElasticSearchClusterConfiguration
     extends ElasticSearchIndexingConfiguration
 {
@@ -130,14 +130,14 @@ properties defined in the filesystem configuration, see above.
Using a provided client
Assembly
Assembly is done using the provided Assembler:
new ESClientIndexQueryAssembler( client )
+configuration.

Using a provided client

Assembly

Assembly is done using the provided Assembler:

new ESClientIndexQueryAssembler( client )
     .withConfig( configModule, configVisibility )
     .assemble( module );
-

Configuration

Here are the configuration properties for the ElasticSearch Index/Query service using a provided client. +

Configuration

Here are the configuration properties for the ElasticSearch Index/Query service using a provided client. Note that the clusterName is ignored as this is managed by the client.

Traceback (most recent call last):
-  File "/Users/paul/.asciidoc/filters/snippet/snippet.py", line 100, in <module>
+  File "/home/niclas/.asciidoc/filters/snippet/snippet.py", line 100, in <module>
     for line in snippet(**configuration(indata)):
-  File "/Users/paul/.asciidoc/filters/snippet/snippet.py", line 51, in snippet
+  File "/home/niclas/.asciidoc/filters/snippet/snippet.py", line 51, in snippet
     sourceFile = open(PATH_PATTERN % locals())
 IOError: [Errno 2] No such file or directory: 'extensions/indexing-elasticsearch/src/main/java/org/apache/polygene/index/elasticsearch/ElasticSearchConfiguration.java'

Again, all configuration properties are defaulted meaning that you can use ElasticSearch Index/Query service without http://git-wip-us.apache.org/repos/asf/polygene-website/blob/538baaf6/content/java/develop/extension-index-rdf.html ---------------------------------------------------------------------- diff --git a/content/java/develop/extension-index-rdf.html b/content/java/develop/extension-index-rdf.html index ac975f4..b7aa7f6 100644 --- a/content/java/develop/extension-index-rdf.html +++ b/content/java/develop/extension-index-rdf.html @@ -1,5 +1,5 @@ -OpenRDF Index/Query +OpenRDF Index/Query @@ -66,9 +66,9 @@ })(); -

Polygene™
Introduction
Tutorials
Javadoc
Samples
Core
Libraries
Extensions
Tools
Glossary

OpenRDF Index/Query

code

docs

tests

Index/Query services backed by OpenRDF Sesame framework for processing RDF data.

Table 66. Artifact

Group ID	Artifact ID	Version
org.apache.polygene.extensions	org.apache.polygene.extension.indexing-rdf	3.1.0-SNAPSHOT

In Memory

Assembly is done using the provided Assembler:

new RdfMemoryStoreAssembler().assemble( module );
-

No configuration needed.

On Filesystem

Assembly

Assembly is done using the provided Assembler:

new RdfNativeSesameStoreAssembler().assemble( module );
-

Configuration

Here are the configuration properties for the Native RDF Index/Query:

public interface NativeConfiguration extends ConfigurationComposite
+  
Polygene™
Introduction
Tutorials
Javadoc
Samples
Core
Libraries
Extensions
Tools
Glossary 
Overview
javax.json serialization
javax.xml serialization
MessagePack serialization
Memory EntityStore
File EntityStore
Geode EntityStore
Hazelcast EntityStore
JClouds EntityStore
JDBM EntityStore
LevelDB EntityStore
MongoDB EntityStore
Preferences EntityStore
Redis EntityStore
Riak EntityStore
SQL EntityStore
SQL Key/Value EntityStore
Ehcache Ca
 che
Memcache Cache
ElasticSearch Index/Query
OpenRDF Index/Query
Apache Solr Index/Query
SQL Index/Query
Codahale Metrics
Migration
Reindexer
OpenRDF Index/Query
code
docs
tests
Index/Query services backed by OpenRDF Sesame framework for processing RDF data.
Table 73. Artifact
Group ID Artifact ID Version
org.apache.polygene.extensions org.apache.polygene.extension.indexing-rdf 0

In Memory
Assembly is done using the provided Assembler:
new RdfMemoryStoreAssembler().assemble( module );
+
No configuration needed.
On Filesystem
Assembly
Assembly is done using the provided Assembler:
new RdfNativeSesameStoreAssembler().assemble( module );
+
Configuration
Here are the configuration properties for the Native RDF Index/Query:
public interface NativeConfiguration extends ConfigurationComposite
 {
     @Optional @Matches( "([spoc][spoc][spoc][spoc],?)*" ) Property<String> tripleIndexes();
 
@@ -76,15 +76,15 @@
 
     @UseDefaults Property<Boolean> forceSync();
 }
-
In a RDBMS
Assembly
Assembly is done using the provided Assembler:
new RdfRdbmsSesameStoreAssembler().assemble( module );
-
Configuration
Here are the configuration properties for the RDBMS based RDF Index/Query:
public interface RdbmsRepositoryConfiguration
+
In a RDBMS
Assembly
Assembly is done using the provided Assembler:
new RdfRdbmsSesameStoreAssembler().assemble( module );
+
Configuration
Here are the configuration properties for the RDBMS based RDF Index/Query:
public interface RdbmsRepositoryConfiguration
 {
     Property<String> jdbcDriver();
     Property<String> jdbcUrl();
     Property<String> user();
     Property<String> password();
 }
-
Named RDF Queries
RDF queries are rather difficult to create manually. Not only do you need to learn a difficult language and a new
+

Group ID	Artifact ID	Version
org.apache.polygene.extensions	org.apache.polygene.extension.indexing-rdf	0

Named RDF Queries

RDF queries are rather difficult to create manually. Not only do you need to learn a difficult language and a new syntax, but also need to understand the indexing model that happens in Apache Polygene RDF indexing system.

Below follows a large set of working queries, which can be used as a starting point. See the testcases for details of the Entity model that is being indexed.

"PREFIX ns0: <urn:polygene:type:org.apache.polygene.api.identity.HasIdentity#> \n"
     + "PREFIX rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#> \n"

http://git-wip-us.apache.org/repos/asf/polygene-website/blob/538baaf6/content/java/develop/extension-index-solr.html
----------------------------------------------------------------------
diff --git a/content/java/develop/extension-index-solr.html b/content/java/develop/extension-index-solr.html
index 4f7fbb8..30e11ed 100644
--- a/content/java/develop/extension-index-solr.html
+++ b/content/java/develop/extension-index-solr.html
@@ -1,5 +1,5 @@
 
-Apache Solr Index/Query
+Apache Solr Index/Query
 
 
 
@@ -66,8 +66,8 @@
   })();
  
 
-  
Polygene™
Introduction
Tutorials
Javadoc
Samples
Core
Libraries
Extensions
Tools
Glossary 
Overview
javax.json serialization
javax.xml serialization
MessagePack serialization
Memory EntityStore
File EntityStore
Geode EntityStore
Hazelcast EntityStore
JClouds EntityStore
JDBM EntityStore
LevelDB EntityStore
MongoDB EntityStore
Preferences EntityStore
Redis EntityStore
Riak EntityStore
SQL Key/Value EntityStore
Ehcache Cache
Memcache Cache
ElasticSearch Index/Query
OpenRDF Index/Query
Apache Solr Index/Query
SQL Index/Query
Codahale Metrics
Migration
Reindexer
Apache Solr Index/Query
code
docs
tests
Index/Query services backed by an embedded Apache Solr Search.
Warning
Solr Index/Query service do not support the Polygene™ Query API but only native Solr queries.
Table 67. Artifact
Group ID Artifact ID Version
org.apache.polygene.extensions org.apache.polygene.extension.indexing-solr 3.1.0-SNAPSHOT

Assembly
Assembly is done using the provided Assembler:
new SolrIndexingAssembler().assemble( module );
-
Configuration
Apache Solr Index/Query exclusively use the FileConfig Library to locate the directory where it persists its index.
You must provide solrconfig.xml and schema.xml files either from the classpath or in the configuration directory of
+  
Polygene™
Introduction
Tutorials
Javadoc
Samples
Core
Libraries
Extensions
Tools
Glossary 
Overview
javax.json serialization
javax.xml serialization
MessagePack serialization
Memory EntityStore
File EntityStore
Geode EntityStore
Hazelcast EntityStore
JClouds EntityStore
JDBM EntityStore
LevelDB EntityStore
MongoDB EntityStore
Preferences EntityStore
Redis EntityStore
Riak EntityStore
SQL EntityStore
SQL Key/Value EntityStore
Ehcache Ca
 che
Memcache Cache
ElasticSearch Index/Query
OpenRDF Index/Query
Apache Solr Index/Query
SQL Index/Query
Codahale Metrics
Migration
Reindexer
Apache Solr Index/Query
code
docs
tests
Index/Query services backed by an embedded Apache Solr Search.
Warning
Solr Index/Query service do not support the Polygene™ Query API but only native Solr queries.
Table 74. Artifact
Group ID Artifact ID Version
org.apache.polygene.extensions org.apache.polygene.extension.indexing-solr 0

Assembly
Assembly is done using the provided Assembler:
new SolrIndexingAssembler().assemble( module );
+
Configuration
Apache Solr Index/Query exclusively use the FileConfig Library to locate the directory where it persists its index.
You must provide solrconfig.xml and schema.xml files either from the classpath or in the configuration directory of
 the FileConfig Library.

         Copyright © 2015 The Apache Software Foundation, Licensed under the Apache License, Version 2.0.
         


http://git-wip-us.apache.org/repos/asf/polygene-website/blob/538baaf6/content/java/develop/extension-indexing-sql.html
----------------------------------------------------------------------
diff --git a/content/java/develop/extension-indexing-sql.html b/content/java/develop/extension-indexing-sql.html
index 9f697cf..52d5934 100644
--- a/content/java/develop/extension-indexing-sql.html
+++ b/content/java/develop/extension-indexing-sql.html
@@ -1,5 +1,5 @@
 
-SQL Index/Query
+SQL Index/Query
 
 
 
@@ -66,14 +66,14 @@
   })();
  
 
-  
Polygene™
Introduction
Tutorials
Javadoc
Samples
Core
Libraries
Extensions
Tools
Glossary 
Overview
javax.json serialization
javax.xml serialization
MessagePack serialization
Memory EntityStore
File EntityStore
Geode EntityStore
Hazelcast EntityStore
JClouds EntityStore
JDBM EntityStore
LevelDB EntityStore
MongoDB EntityStore
Preferences EntityStore
Redis EntityStore
Riak EntityStore
SQL Key/Value EntityStore
Ehcache Cache
Memcache Cache
ElasticSearch Index/Query
OpenRDF Index/Query
Apache Solr Index/Query
SQL Index/Query
Codahale Metrics
Migration
Reindexer
SQL Index/Query
code
docs
tests
This extension fully leverage the SQL Library meaning that you must use it to assemble your DataSource and that you
-get Circuit Breaker and JMX integration for free.
Tip
See the SQL Support Sample that demonstrate combined use of SQL Library,  SQL Key/Value EntityStore and
-SQL Index/Query.
The following SQL databases are supported:

+  
Polygene™
Introduction
Tutorials
Javadoc
Samples
Core
Libraries
Extensions
Tools
Glossary 
Overview
javax.json serialization
javax.xml serialization
MessagePack serialization
Memory EntityStore
File EntityStore
Geode EntityStore
Hazelcast EntityStore
JClouds EntityStore
JDBM EntityStore
LevelDB EntityStore
MongoDB EntityStore
Preferences EntityStore
Redis EntityStore
Riak EntityStore
SQL EntityStore
SQL Key/Value EntityStore
Ehcache Ca
 che
Memcache Cache
ElasticSearch Index/Query
OpenRDF Index/Query
Apache Solr Index/Query
SQL Index/Query
Codahale Metrics
Migration
Reindexer
SQL Index/Query
code
docs
tests
This extension fully leverage the SQL Library meaning that you must use it to assemble your DataSource and that you
+get Circuit Breaker and JMX integration for free.
Tip
See the SQL Support Sample that demonstrate combined use of SQL Library,  SQL Key/Value EntityStore and
+SQL Index/Query.
The following SQL databases are supported:

 PostgreSQL
 
Implementations per database Vendor share a generic codebase but can override about everything SQL. As a consequence
-they can have strong differences in terms of performance if they use vendor specific extensions.
Table 68. Artifact
Group ID Artifact ID Version
org.apache.polygene.extensions org.apache.polygene.extension.indexing-sql 3.1.0-SNAPSHOT

Configuration
SQL Index/Query Configuration is optional a
 nd provides only one configuration property: schemaName defaulted to
+they can have strong differences in terms of performance if they use vendor specific extensions.
Table 75. Artifact
Group ID Artifact ID Version
org.apache.polygene.extensions org.apache.polygene.extension.indexing-sql 0

Configuration
SQL Index/Query Configuration is optional and provides only one configur
 ation property: schemaName defaulted to
 polygene_es. On SQL databases that don’t support schemas this configuration property is simply ignored.
The assembly snippets below show the DataSource assembly alongside the SQL Index/Query assembly. Remember to configure
-the DataSource properly, see SQL Library and Configure a Service.
PostgreSQL
Assembly is done using the provided Assembler:
// DataSourceService
+the DataSource properly, see SQL Library and Configure a Service.
PostgreSQL
Assembly is done using the provided Assembler:
// DataSourceService
 new DBCPDataSourceServiceAssembler().
     identifiedBy( "postgres-datasource-service" ).
     visibleIn( Visibility.module ).
@@ -117,7 +117,7 @@ enabled=true
 #url=jdbc:postgresql://localhost:5432/jdbc_test_db
 driver=org.postgresql.Driver
 username=jdbc_test_login
-password=password
Important
The PostgreSQL ltree extension is needed on the used database, see below how to install it on your database.
Installing ltree on PostgreSQL >= 9.1 ==
It’s bundled with PostgreSQL but you need to activate it on your database:
CREATE EXTENSION ltree;
Installing ltree on PostgreSQL ⇐ 9.0
You need to install postgresql-contrib and import the module in your database.
+password=password

Group ID	Artifact ID	Version
org.apache.polygene.extensions	org.apache.polygene.extension.indexing-solr	3.1.0-SNAPSHOT

Group ID	Artifact ID	Version
org.apache.polygene.extensions	org.apache.polygene.extension.indexing-solr	0

Group ID	Artifact ID	Version
org.apache.polygene.extensions	org.apache.polygene.extension.indexing-sql	3.1.0-SNAPSHOT

Group ID	Artifact ID	Version
org.apache.polygene.extensions	org.apache.polygene.extension.indexing-sql	0

Important

~~The PostgreSQL ltree extension is needed on the used database, see below how to install it on your database.~~

Installing ltree on PostgreSQL >= 9.1 ==

~~It’s bundled with PostgreSQL but you need to activate it on your database:~~

CREATE EXTENSION ltree;

Installing ltree on PostgreSQL ⇐ 9.0

~~You need to install postgresql-contrib and import the module in your database. The following applies to Debian based distributions, adapt it to yours:~~

~~Install the contrib package: sudo apt-get install postgresql-contrib~~
http://git-wip-us.apache.org/repos/asf/polygene-website/blob/538baaf6/content/java/develop/extension-metrics-metrics.html ---------------------------------------------------------------------- diff --git a/content/java/develop/extension-metrics-metrics.html b/content/java/develop/extension-metrics-metrics.html index 224f0a2..21e8a14 100644 --- a/content/java/develop/extension-metrics-metrics.html +++ b/content/java/develop/extension-metrics-metrics.html @@ -1,5 +1,5 @@ -Codahale Metrics +Codahale Metrics @@ -66,9 +66,9 @@ })(); -
Polygene™
Introduction
Tutorials
Javadoc
Samples
Core
Libraries
Extensions
Tools
Glossary
Overview
javax.json serialization
javax.xml serialization
MessagePack serialization
Memory EntityStore
File EntityStore
Geode EntityStore
Hazelcast EntityStore
JClouds EntityStore
JDBM EntityStore
LevelDB EntityStore
MongoDB EntityStore
Preferences EntityStore
Redis EntityStore
Riak EntityStore
SQL Key/Value EntityStore
Ehcache Cache
Memcache Cache
ElasticSearch Index/Query
OpenRDF Index/Query
Apache Solr Index/Query
SQL Index/Query
Codahale Metrics
Migration
Reindexer
Codahale Metrics
code
docs
tests
Metrics extension backed by the Codahale metrics library -maintained by the Dropwizard folks.
Table 69. Artifact
Group ID Artifact ID Version
org.apache.polygene.extensions
org.apache.polygene.extension.metrics-codahale
3.1.0-SNAPSHOT

Assembly
Assembly is done using the provided Assembler:< /p>
return new CodahaleMetricsAssembler(); -
Reporting to Ganglia or Graphite
Dropwizard provide metrics reporter for Ganglia or Graphite, see the official documentation +
Polygene™
Introduction
Tutorials
Javadoc
Samples
Core
Libraries
Extensions
Tools
Glossary
Overview
javax.json serialization
javax.xml serialization
MessagePack serialization
Memory EntityStore
File EntityStore
Geode EntityStore
Hazelcast EntityStore
JClouds EntityStore
JDBM EntityStore
LevelDB EntityStore
MongoDB EntityStore
Preferences EntityStore
Redis EntityStore
Riak EntityStore
SQL EntityStore
SQL Key/Value EntityStore
Ehcache Ca che
Memcache Cache
ElasticSearch Index/Query
OpenRDF Index/Query
Apache Solr Index/Query
SQL Index/Query
Codahale Metrics
Migration
Reindexer
Codahale Metrics
code
docs
tests
Metrics extension backed by the Codahale metrics library +maintained by the Dropwizard folks.
Table 76. Artifact
Group ID Artifact ID Version
org.apache.polygene.extensions
org.apache.polygene.extension.metrics-codahale
0

Assembly
Assembly is done using the provided Assembler:
return new CodahaleMetricsAssembler(); +
Reporting to Ganglia or Graphite
Dropwizard provide metrics reporter for Ganglia or Graphite, see the official documentation for details.
To register reporters you need a handle to the underlying MetricsRegistry, the CodahaleMetricsProvider service provide accessor to it:
CodahaleMetricsProvider metricsProvider = module.findService( CodahaleMetricsProvider.class ).get(); [...snip...]