OpenSearchServer Output Connection

MetaCarta GTS Output Connection

The MetaCarta GTS output connection type is designed to allow ManifoldCF to submit documents to an appropriate MetaCarta GTS search Modified: incubator/lcf/branches/CONNECTORS-240/site/src/documentation/content/xdocs/how-to-build-and-deploy.xml URL: http://svn.apache.org/viewvc/incubator/lcf/branches/CONNECTORS-240/site/src/documentation/content/xdocs/how-to-build-and-deploy.xml?rev=1163956&r1=1163955&r2=1163956&view=diff ============================================================================== --- incubator/lcf/branches/CONNECTORS-240/site/src/documentation/content/xdocs/how-to-build-and-deploy.xml (original) +++ incubator/lcf/branches/CONNECTORS-240/site/src/documentation/content/xdocs/how-to-build-and-deploy.xml Thu Sep 1 09:15:42 2011 @@ -68,6 +68,7 @@

MetaCarta GTS output connector
Apache Solr output connector
OpenSearchServer output connector
Null output connector

@@ -584,6 +585,7 @@ log4j.appender.MAIN.layout.ConversionPat org.apache.manifoldcf.agents.Registerorg.apache.manifoldcf.crawler.system.CrawlerAgent org.apache.manifoldcf.agents.RegisterOutputorg.apache.manifoldcf.agents.output.gts.GTSConnector "GTS Connector" org.apache.manifoldcf.agents.RegisterOutputorg.apache.manifoldcf.agents.output.solr.SolrConnector "SOLR Connector" + org.apache.manifoldcf.agents.RegisterOutputorg.apache.manifoldcf.agents.output.opensearchserver.OpenSearchServerConnector "OpenSearchServer Connector" org.apache.manifoldcf.agents.RegisterOutputorg.apache.manifoldcf.agents.output.nullconnector.NullConnector "Null Connector" org.apache.manifoldcf.authorities.RegisterAuthorityorg.apache.manifoldcf.authorities.authorities.activedirectory.ActiveDirectoryAuthority "Active Directory Authority" org.apache.manifoldcf.crawler.Registerorg.apache.manifoldcf.crawler.connectors.cmis.CmisRepositoryConnector "CMIS" Modified: incubator/lcf/branches/CONNECTORS-240/site/src/documentation/content/xdocs/included-connectors.xml URL: http://svn.apache.org/viewvc/incubator/lcf/branches/CONNECTORS-240/site/src/documentation/content/xdocs/included-connectors.xml?rev=1163956&r1=1163955&r2=1163956&view=diff ============================================================================== --- incubator/lcf/branches/CONNECTORS-240/site/src/documentation/content/xdocs/included-connectors.xml (original) +++ incubator/lcf/branches/CONNECTORS-240/site/src/documentation/content/xdocs/included-connectors.xml Thu Sep 1 09:15:42 2011 @@ -41,7 +41,7 @@ RSS Pure Java N/A N/A Atom, RSS 2.0, others Web Pure Java N/A N/A HTML Version 1.0, 1.1, 2.0, Atom, RSS 2.0, others LiveLink (OpenText) Pure Java Win LAPI 9.7.1 Tested with 9.2.0 - 9.7.1 - Open Search Server Pure Java N/A Unknown Unknown + OpenSearchServer Pure Java Win/*NIX N/A Tested with OpenSearchServer 1.2.1 Documentum (EMC) Win, RedHat Win, RedHat Tested with DFC 5.3 SP5 Tested against 5.3, 6.0, and 6.5 servers SharePoint (MSFT)Pure Java Win N/A Tested with SharePoint 2003 (2.0), 2007 (3.0) Meridio (Autonomy) Pure Java Win N/A Tested with Meridio 4.1, 5.0 Modified: incubator/lcf/branches/CONNECTORS-240/site/src/documentation/content/xdocs/index.xml URL: http://svn.apache.org/viewvc/incubator/lcf/branches/CONNECTORS-240/site/src/documentation/content/xdocs/index.xml?rev=1163956&r1=1163955&r2=1163956&view=diff ============================================================================== --- incubator/lcf/branches/CONNECTORS-240/site/src/documentation/content/xdocs/index.xml (original) +++ incubator/lcf/branches/CONNECTORS-240/site/src/documentation/content/xdocs/index.xml Thu Sep 1 09:15:42 2011 @@ -29,8 +29,8 @@

What Is ManifoldCF? -

ManifoldCF is an effort to provide an open source framework for connecting source content repositories like Microsoft Sharepoint and EMC Documentum, to target repositories or indexes, such as Apache Solr. ManifoldCF also defines a security model for target repositories that permits them to enforce source-repository security policies.

Currently included connectors support FileNet P8 (IBM), Documentum (EMC), LiveLink (OpenText), Patriarch (Memex), Meridio (Autonomy), Windows shares (Microsoft), and SharePoint (Microsoft). Also included are a general CMIS connector, a general file system connector, a general JDBC connector, a general RSS crawler, and a general web crawler. Currently supported targets include Apache Solr and QBase (formerly MetaCarta) GTS. The complete repository compatibility list can be found here.

ManifoldCF is an effort to provide an open source framework for connecting source content repositories like Microsoft Sharepoint and EMC Documentum, to target repositories or indexes, such as Apache Solr or OpenSearchServer. ManifoldCF also defines a security model for target repositories that permits them to enforce source-repository security policies.

Currently included connectors support FileNet P8 (IBM), Documentum (EMC), LiveLink (OpenText), Patriarch (Memex), Meridio (Autonomy), Windows shares (Microsoft), and SharePoint (Microsoft). Also included are a general CMIS connector, a general file system connector, a general JDBC connector, a general RSS crawler, and a general web crawler. Currently supported targets include Apache Solr, QBase (formerly MetaCarta) GTS and OpenSearchServer. The complete repository compatibility list can be found here.

The original ManifoldCF code base was granted by MetaCarta, Inc., to the Apache Software Foundation in December 2009. The MetaCarta effort represented more than five years of successful development and testing in multiple, challenging enterprise environments.

Modified: incubator/lcf/branches/CONNECTORS-240/site/src/documentation/content/xdocs/writing-output-connectors.xml URL: http://svn.apache.org/viewvc/incubator/lcf/branches/CONNECTORS-240/site/src/documentation/content/xdocs/writing-output-connectors.xml?rev=1163956&r1=1163955&r2=1163956&view=diff ============================================================================== --- incubator/lcf/branches/CONNECTORS-240/site/src/documentation/content/xdocs/writing-output-connectors.xml (original) +++ incubator/lcf/branches/CONNECTORS-240/site/src/documentation/content/xdocs/writing-output-connectors.xml Thu Sep 1 09:15:42 2011 @@ -63,7 +63,7 @@

A very good place to start is to read the javadoc for the output connector interface. You will note that the javadoc describes the usage and pooling model for a connector class pretty thoroughly. It is very important to understand the model thoroughly in order to write reliable connectors! Use of static variables, for one thing, must be done in a very careful way, to avoid issues that would be hard to detect with a cursory test.

The second thing to do is to examine some of the provided output connector implementations. The GTS connector, the SOLR connector, and the Null Output connector all are output connectors which demonstrate (to some degree) the sorts of techniques you will need for an effective implementation. You will also note that all of these connectors extend a framework-provided output connector base class, found at org.apache.manifoldcf.agents.output.BaseOutputConnector. This base class furnishes some basic bookkeeping logic for managing the connector pool, as well as default implementations of some of the less typical functionality a connector may have. For example, connectors are allowed to have database tables of their own, which are instantiated when the connector is registered, and are torn down when the connector is removed. This is, however, not very typical, and the base implementation reflects that.

The second thing to do is to examine some of the provided output connector implementations. The GTS connector, the SOLR connector, the OpenSearchServer connector, and the Null Output connector all are output connectors which demonstrate (to some degree) the sorts of techniques you will need for an effective implementation. You will also note that all of these connectors extend a framework-provided output connector base class, found at org.apache.manifoldcf.agents.output.BaseOutputConnector. This base class furnishes some basic bookkeeping logic for managing the connector pool, as well as default implementations of some of the less typical functionality a connector may have. For example, connectors are allowed to have database tables of their own, which are instantiated when the connector is registered, and are torn down when the connector is removed. This is, however, not very typical, and the base implementation reflects that.

Principle methods