nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lewis John McGibbney (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (NUTCH-902) Add all necessary files and configuration so that nutch can be used with different backends out-of-the-box
Date Tue, 01 Nov 2011 15:21:33 GMT

    [ https://issues.apache.org/jira/browse/NUTCH-902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13141231#comment-13141231
] 

Lewis John McGibbney commented on NUTCH-902:
--------------------------------------------

There are some slight problems here, I was getting a problem with unresolved dependencies
when I was building Nutchgora with Cassandra as backend, so you need to add the following
to ivy/ivy.xml
{code}
<!--
    	Uncomment this to use Cassandra as Gora backend. 
-->

		<dependency org="org.apache.gora" name="gora-cassandra" rev="0.1.1-incubating" conf="*->default">
			<exclude org="org.apache.thrift" />
			<exclude org="org.apache.cassandra" />
		</dependency>
{code}

Enis, I completely agree with your comment, that every dependency should be managed from within
Gora, however if the changes are not in the above gora dependency on maven repo then we cannot
use them, therefore the exclusions need to be added in Nutchgora_home/ivy/ivy.xml prior to
using the ant runtime target. I will attach a patch for the following in due course.
                
> Add all necessary files and configuration so that nutch can be used with different backends
out-of-the-box
> ----------------------------------------------------------------------------------------------------------
>
>                 Key: NUTCH-902
>                 URL: https://issues.apache.org/jira/browse/NUTCH-902
>             Project: Nutch
>          Issue Type: New Feature
>          Components: documentation, storage
>    Affects Versions: nutchbase
>            Reporter: Enis Soztutar
>            Assignee: Lewis John McGibbney
>             Fix For: nutchgora
>
>         Attachments: NUTCH-902-v2.patch, NUTCH-902.patch
>
>
> As per the discussion in the mailing list and http://wiki.apache.org/nutch/GORA_HBase,
it will be good to include all the necessary files and configuration. I propose that we maintain
configuration for at least SQL, HBase and Cassandra. 
> The following changes are needed:
> conf/gora-sql-mapping.xml
> conf/gora-hbase-mapping.xml
> conf/gora-cassandra-mapping.xml
> comments on nutch-default and ivy.xml 
> Shall we also include jars from gora-hbase, gora-cassandra and their dependencies ? 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message