lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "tom liu (JIRA)" <j...@apache.org>
Subject [jira] Issue Comment Edited: (SOLR-1395) Integrate Katta
Date Fri, 05 Nov 2010 03:52:43 GMT

    [ https://issues.apache.org/jira/browse/SOLR-1395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12928464#action_12928464
] 

tom liu edited comment on SOLR-1395 at 11/4/10 11:51 PM:
---------------------------------------------------------

JohnWu,Huang :

in katta integrations, the solr core has three roles:
# proxy, that is query dispatches or front server.
all query would be sent to this proxy, and then dispatch to subproxy on katta cluster node.
in this proxy, QueryComponent's distributedProcess would be executed. but the param isShard=false.
# subproxy, that is proxy on katta cluster node. 
because each node maybe has more than one cores, so subproxy would receive query from proxy,
and send query to any core.
in this subproxy, QueryComponent's distributedProcess would be executed. but the param isShard=true.
# queryCore, that is real query solr core.
any query would be sent to querycore, and the querycore execute QueryComponent's process method.

so, when run solr cluster or distribution, we would setup three envs.
# proxy's solrconfig.xml 
{noformat}
<requestHandler name="standard" class="solr.KattaRequestHandler" default="true">
    <lst name="defaults">
        <str name="echoParams">explicit</str>
        <str name="shards">*</str>
     </lst>
</requestHandler>
{noformat}
# subproxy's solrconfig.xml
<requestHandler name="standard" class="solr.SearchHandler" default="true">...</requestHandler>
# querycore's solrconfig.xml
<requestHandler name="standard" class="solr.SearchHandler" default="true">...</requestHandler>

in katta's katta.node.properties::
node.server.class=org.apache.solr.katta.DeployableSolrKattaServer

and in classes dirs of proxy's solr webapps
pls add two files:
# katta.zk.properties
# katta.node.properties

      was (Author: tom_lt):
    JohnWu,Huang :

in katta integrations, the solr core has three roles:
# proxy, that is query dispatches or front server.
all query would be sent to this proxy, and then dispatch to subproxy on katta cluster node.
in this proxy, QueryComponent's distributedProcess would be executed. but the param isShard=false.
# subproxy, that is proxy on katta cluster node. 
because each node maybe has more than one cores, so subproxy would receive query from proxy,
and send query to any core.
in this subproxy, QueryComponent's distributedProcess would be executed. but the param isShard=true.
# queryCore, that is real query solr core.
any query would be sent to querycore, and the querycore execute QueryComponent's process method.

so, when run solr cluster or distribution, we would setup three envs.
# proxy's solrconfig.xml 
{noformat}
<requestHandler name="standard" class="solr.KattaRequestHandler" default="true">
    <lst name="defaults">
        <str name="echoParams">explicit</str>
        <str name="shards">*</str>
     </lst>
</requestHandler>
{noformat}
# subproxy's solrconfig.xml
<requestHandler name="standard" class="solr.SearchHandler" default="true">...</requestHandler>
# querycore's solrconfig.xml
<requestHandler name="standard" class="solr.SearchHandler" default="true">...</requestHandler>

in katta's katta.node.properties::
node.server.class=org.apache.solr.katta.DeployableSolrKattaServer
  
> Integrate Katta
> ---------------
>
>                 Key: SOLR-1395
>                 URL: https://issues.apache.org/jira/browse/SOLR-1395
>             Project: Solr
>          Issue Type: New Feature
>    Affects Versions: 1.4
>            Reporter: Jason Rutherglen
>            Priority: Minor
>             Fix For: Next
>
>         Attachments: back-end.log, front-end.log, hadoop-core-0.19.0.jar, katta-core-0.6-dev.jar,
katta.node.properties, katta.zk.properties, log4j-1.2.13.jar, solr-1395-1431-3.patch, solr-1395-1431-4.patch,
solr-1395-1431-katta0.6.patch, solr-1395-1431-katta0.6.patch, solr-1395-1431.patch, solr-1395-katta-0.6.2-1.patch,
solr-1395-katta-0.6.2-2.patch, solr-1395-katta-0.6.2.patch, SOLR-1395.patch, SOLR-1395.patch,
SOLR-1395.patch, test-katta-core-0.6-dev.jar, zkclient-0.1-dev.jar, zookeeper-3.2.1.jar
>
>   Original Estimate: 336h
>  Remaining Estimate: 336h
>
> We'll integrate Katta into Solr so that:
> * Distributed search uses Hadoop RPC
> * Shard/SolrCore distribution and management
> * Zookeeper based failover
> * Indexes may be built using Hadoop

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message