manifoldcf-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karl Wright (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CONNECTORS-1142) initialize.sh fails because connector-common-lib dependencies not in classpath
Date Wed, 14 Jan 2015 07:02:34 GMT

    [ https://issues.apache.org/jira/browse/CONNECTORS-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14276582#comment-14276582
] 

Karl Wright commented on CONNECTORS-1142:
-----------------------------------------

Hi Michael,

These dependencies are all ones that are found in connector-common-lib:

{code}
 Directory of C:\wip\mcf\trunk\dist\connector-common-lib

01/11/2015  07:30 PM    <DIR>          .
01/11/2015  07:30 PM    <DIR>          ..
01/11/2015  07:30 PM            69,409 activation-1.1.1.jar
01/11/2015  07:30 PM            95,536 apache-mime4j-core-0.7.2.jar
01/11/2015  07:30 PM           304,810 apache-mime4j-dom-0.7.2.jar
01/11/2015  07:30 PM            47,359 asm-4.1.jar
01/11/2015  07:30 PM            19,812 asm-analysis-4.1.jar
01/11/2015  07:30 PM            38,090 asm-commons-4.1.jar
01/11/2015  07:30 PM           342,664 asm-debug-all-4.1.jar
01/11/2015  07:30 PM            22,162 asm-tree-4.1.jar
01/11/2015  07:30 PM            37,599 asm-util-4.1.jar
01/11/2015  07:30 PM           117,099 aspectjrt-1.8.0.jar
01/11/2015  07:30 PM         1,599,570 axis-1.4.jar
01/11/2015  07:30 PM            31,191 axis-jaxrpc-1.4.jar
01/11/2015  07:30 PM           229,116 bcmail-jdk15-1.45.jar
01/11/2015  07:30 PM         1,663,318 bcprov-jdk15-1.45.jar
01/11/2015  07:30 PM            92,027 boilerpipe-1.1.0.jar
01/11/2015  07:30 PM         2,095,141 castor-1.0.5.jar
01/11/2015  07:30 PM           365,552 commons-compress-1.8.1.jar
01/11/2015  07:30 PM            79,796 commons-discovery-0.5.jar
01/11/2015  07:30 PM           313,898 dom4j-1.6.1.jar
01/11/2015  07:30 PM           218,560 fontbox-1.8.6.jar
01/11/2015  07:30 PM           223,298 geronimo-javamail_1.4_spec-1.7.1.jar
01/11/2015  07:30 PM           689,486 isoparser-1.0.2.jar
01/11/2015  07:30 PM            34,474 jackson-annotations-2.1.2.jar
01/11/2015  07:30 PM           206,797 jackson-core-2.1.3.jar
01/11/2015  07:30 PM           925,482 jackson-databind-2.1.3.jar
01/11/2015  07:30 PM            85,452 java-libpst-0.8.1.jar
01/11/2015  07:30 PM           153,253 jdom-1.0.jar
01/11/2015  07:30 PM            50,982 jempbox-1.8.6.jar
01/11/2015  07:30 PM            93,310 jhighlight-1.0.jar
01/11/2015  07:30 PM            66,536 jmatio-1.0.jar
01/11/2015  07:30 PM           220,813 juniversalchardet-1.0.3.jar
01/11/2015  07:30 PM           114,804 mcf-connector-common.jar
01/11/2015  07:30 PM           211,185 metadata-extractor-2.6.2.jar
01/11/2015  07:30 PM           155,714 opensaml-1.1.jar
01/11/2015  07:30 PM         4,040,495 pdfbox-1.8.6.jar
01/11/2015  07:30 PM         2,054,958 poi-3.11-beta2.jar
01/11/2015  07:30 PM         1,111,398 poi-ooxml-3.11-beta2.jar
01/11/2015  07:30 PM         5,161,257 poi-ooxml-schemas-3.11-beta2.jar
01/11/2015  07:30 PM         1,288,743 poi-scratchpad-3.11-beta2.jar
01/11/2015  07:30 PM           219,683 rome-1.0.jar
01/11/2015  07:30 PM            18,817 saaj-api-1.3.jar
01/11/2015  07:30 PM           283,779 saaj-impl-1.3.3.jar
01/11/2015  07:30 PM            90,722 tagsoup-1.2.1.jar
01/11/2015  07:30 PM           507,965 tika-core-1.6.jar
01/11/2015  07:30 PM           557,502 tika-parsers-1.6.jar
01/11/2015  07:30 PM            76,323 vorbis-java-core-0.6.jar
01/11/2015  07:30 PM            22,962 vorbis-java-tika-0.6.jar
01/11/2015  07:30 PM           148,429 wsdl4j-1.6.2.jar
01/11/2015  07:30 PM           337,532 wss4j-1.5.12.jar
01/11/2015  07:30 PM         1,363,159 xercesImpl-2.10.0.jar
01/11/2015  07:30 PM           220,536 xml-apis-1.4.01.jar
01/11/2015  07:30 PM         2,730,866 xmlbeans-2.6.0.jar
01/11/2015  07:30 PM           413,902 xmlsec-1.4.0.jar
01/11/2015  07:30 PM           117,333 xmpcore-5.1.2.jar
01/11/2015  07:30 PM            99,555 xz-1.5.jar
              55 File(s)     31,880,211 bytes
               2 Dir(s)  34,200,256,512 bytes free
{code}

They must  be loaded via the classloader, which is mentioned in properties.xml:

{code}
  <!-- Tell MCF where to find the connector jars -->
  <libdir path="../connector-lib"/>
  <libdir path="../connector-common-lib"/>
  <libdir path="../connector-lib-proprietary"/>
{code}

That's a change from previous releases of MCF, so if you are using an older properties.xml,
that would explain the problem.


> initialize.sh fails because connector-common-lib dependencies not in classpath
> ------------------------------------------------------------------------------
>
>                 Key: CONNECTORS-1142
>                 URL: https://issues.apache.org/jira/browse/CONNECTORS-1142
>             Project: ManifoldCF
>          Issue Type: Bug
>    Affects Versions: ManifoldCF 2.0
>            Reporter: Michael Wilken
>            Priority: Minor
>
> Running initialize.sh from apache-manifoldcf-2.0/multiprocess-file-example in a fresh
ManifoldCF 2.0 install fails because of missing libraries on the classpath:
> {code}
> [wilkenm@localhost:multiprocess-file-example ]$ ./initialize.sh
> Configuration file successfully read
> Successfully unregistered all domains
> Successfully unregistered all output connectors
> Successfully unregistered all transformation connectors
> Successfully unregistered all mapping connectors
> Successfully unregistered all authority connectors
> Successfully unregistered all repository connectors
> Successfully registered output connector 'org.apache.manifoldcf.agents.output.solr.SolrConnector'
> Successfully registered output connector 'org.apache.manifoldcf.agents.output.opensearchserver.OpenSearchServerConnector'
> Successfully registered output connector 'org.apache.manifoldcf.agents.output.nullconnector.NullConnector'
> Successfully registered output connector 'org.apache.manifoldcf.agents.output.hdfs.HDFSOutputConnector'
> Successfully registered output connector 'org.apache.manifoldcf.agents.output.gts.GTSConnector'
> Successfully registered output connector 'org.apache.manifoldcf.agents.output.filesystem.FileOutputConnector'
> Successfully registered output connector 'org.apache.manifoldcf.agents.output.elasticsearch.ElasticSearchConnector'
> Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/manifoldcf/connectorcommon/jsongen/JSONReader
>     at java.lang.Class.forName0(Native Method)
>     at java.lang.Class.forName(Class.java:270)
>     at org.apache.manifoldcf.core.system.ManifoldCFResourceLoader.findClass(ManifoldCFResourceLoader.java:149)
>     at org.apache.manifoldcf.core.system.ManifoldCF.findClass(ManifoldCF.java:1522)
>     at org.apache.manifoldcf.core.interfaces.ConnectorFactory.getThisConnectorRaw(ConnectorFactory.java:144)
>     at org.apache.manifoldcf.core.interfaces.ConnectorFactory.getThisConnectorNoCheck(ConnectorFactory.java:118)
>     at org.apache.manifoldcf.core.interfaces.ConnectorFactory.installThis(ConnectorFactory.java:48)
>     at org.apache.manifoldcf.agents.interfaces.OutputConnectorFactory.install(OutputConnectorFactory.java:70)
>     at org.apache.manifoldcf.agents.outputconnmgr.OutputConnectorManager.registerConnector(OutputConnectorManager.java:180)
>     at org.apache.manifoldcf.crawler.system.ManifoldCF.registerConnectors(ManifoldCF.java:492)
>     at org.apache.manifoldcf.crawler.system.ManifoldCF.reregisterAllConnectors(ManifoldCF.java:151)
>     at org.apache.manifoldcf.crawler.InitializeAndRegister.doExecute(InitializeAndRegister.java:43)
>     at org.apache.manifoldcf.crawler.InitializeAndRegister.main(InitializeAndRegister.java:60)
> Caused by: java.lang.ClassNotFoundException: org.apache.manifoldcf.connectorcommon.jsongen.JSONReader
>     at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
>     at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
>     at java.security.AccessController.doPrivileged(Native Method)
>     at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
>     at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
>     at java.net.FactoryURLClassLoader.loadClass(URLClassLoader.java:789)
>     at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
>     ... 13 more
> {code}
> This is easily fixed by adding the following needed libs to the options.env.unix file:
> ../connector-common-lib/mcf-connector-common.jar
> ../connector-common-lib/tika-core-1.6.jar
> ../connector-common-lib/axis-1.4.jar
> options.env.unix (and .win) are create during the build process, and I'm not familiar
enough with Ant to provide a patch.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message