lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "A.Eibner" <a_eib...@yahoo.de>
Subject Re: Empty Solr 4.2.1 can not create Collection
Date Tue, 16 Apr 2013 07:52:10 GMT
Hi,
sorry for pushing, but I just replayed the steps with solr 4.0 where 
everything works fine.
Then I switched to solr 4.2.1 and replayed the exact same steps and the 
collection won't start and no leader will be elected.

Any clues ?
Should I try it on the developer mailing list, maybe it's a bug ?

Kind Regards
Alexander

Am 2013-04-10 22:27, schrieb A.Eibner:
> Hi,
>
> here the clusterstate.json (from zookeeper) after creating the core:
>
> {"storage":{
>      "shards":{"shard1":{
>          "range":"80000000-7fffffff",
>          "state":"active",
>          "replicas":{"app02:9985_solr_storage-core":{
>              "shard":"shard1",
>              "state":"down",
>              "core":"storage-core",
>              "collection":"storage",
>              "node_name":"app02:9985_solr",
>              "base_url":"http://app02:9985/solr"}}}},
>      "router":"compositeId"}}
> cZxid = 0x100000024
> ctime = Wed Apr 10 22:18:13 CEST 2013
> mZxid = 0x10000003d
> mtime = Wed Apr 10 22:21:26 CEST 2013
> pZxid = 0x100000024
> cversion = 0
> dataVersion = 2
> aclVersion = 0
> ephemeralOwner = 0x0
> dataLength = 467
> numChildren = 0
>
> But looking in the log files I found the following error (this also
> occures with the collection api)
>
> SEVERE: org.apache.solr.common.SolrException: Error CREATEing SolrCore
> 'storage_shard1_replica1':
>          at
> org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:483)
>
>          at
> org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:140)
>
>          at
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
>
>          at
> org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:591)
>
>          at
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:192)
>
>          at
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:141)
>
>          at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
>
>          at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
>
>          at
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:225)
>
>          at
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:169)
>
>          at
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:168)
>
>          at
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:98)
>
>          at
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
>
>          at
> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:407)
>          at
> org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:999)
>
>          at
> org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:565)
>
>          at
> org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:307)
>
>          at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>
>          at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>
>          at java.lang.Thread.run(Thread.java:722)
> Caused by: org.apache.solr.common.cloud.ZooKeeperException:
>          at
> org.apache.solr.core.CoreContainer.registerInZk(CoreContainer.java:931)
>          at
> org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:892)
>          at
> org.apache.solr.core.CoreContainer.register(CoreContainer.java:841)
>          at
> org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:479)
>
>          ... 19 more
> Caused by: java.lang.NullPointerException
>          at
> org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:190)
>
>          at
> org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:156)
>
>          at
> org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:100)
>
>          at
> org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:266)
>          at
> org.apache.solr.cloud.ZkController.joinElection(ZkController.java:935)
>          at
> org.apache.solr.cloud.ZkController.register(ZkController.java:761)
>          at
> org.apache.solr.cloud.ZkController.register(ZkController.java:727)
>          at
> org.apache.solr.core.CoreContainer.registerInZk(CoreContainer.java:908)
>          ... 22 more
>
> Kind regards
> Alexander
>
> Am 2013-04-10 19:12, schrieb Joel Bernstein:
>> Can you post what your clusterstate.json?
>>
>> After you spin up the initial core, it will automatically become
>> leader for
>> that shard.
>>
>>
>> On Wed, Apr 10, 2013 at 3:43 AM, A.Eibner <a_eibner@yahoo.de> wrote:
>>
>>> Hi Joel,
>>>
>>> I followed your steps, the cores and collection get created, but
>>> there is
>>> no leader elected so I can not query the collection...
>>> Do I miss something ?
>>>
>>> Kind Regards
>>> Alexander
>>>
>>> Am 2013-04-09 10:21, schrieb A.Eibner:
>>>
>>>   Hi,
>>>> thanks for your faster answer.
>>>>
>>>> You don't use the Collection API - may I ask you why ?
>>>> Therefore you have to setup everything (replicas, ...) manually...,
>>>> which I would like to avoid.
>>>>
>>>> Also what I don't understand, why my steps work in 4.0 but won't in
>>>> 4.2.1...
>>>> Any clues ?
>>>>
>>>> Kind Regards
>>>> Alexander
>>>>
>>>> Am 2013-04-08 19:12, schrieb Joel Bernstein:
>>>>
>>>>> The steps that I use to setup the collection are slightly different:
>>>>>
>>>>>
>>>>> 1) Start zk and upconfig the config set. Your approach is same.
>>>>> 2) Start appservers with Solr zkHost set to the zk started in step 1.
>>>>> 3) Use a core admin command to spin up a new core and collection.
>>>>>
>>>>>
>>>>> http://app01/solr/admin/cores?**action=CREATE&name=storage-**
>>>>> core&collection=storage&**numShards=1&collection.**
>>>>> configName=storage-conf<http://app01/solr/admin/cores?action=CREATE&name=storage-core&collection=storage&numShards=1&collection.configName=storage-conf>
>>>>>
>>>>> <http:/**/app03/solr/admin/collections?**action=CREATE&name=storage&**
>>>>> numShards=1&replicationFactor=**2&collection.configName=**storage-conf<http://app03/solr/admin/collections?action=CREATE&name=storage&numShards=1&replicationFactor=2&collection.configName=storage-conf>
>>>>>
>>>>>>
>>>>>
>>>>> &shard=shard1
>>>>>
>>>>> This will spin up the new collection and initial core. I'm not using
a
>>>>> replication factor because the following commands manually bind the
>>>>> replicas.
>>>>>
>>>>> 4) Spin up replica with a core admin command:
>>>>> http://app02/solr/admin/cores?**action=CREATE&name=storage-**
>>>>> core&collection=storage&<http://app02/solr/admin/cores?action=CREATE&name=storage-core&collection=storage&>
>>>>>
>>>>> <http:**//app03/solr/admin/**collections?action=CREATE&**
>>>>> name=storage&numShards=1&**replicationFactor=2&**
>>>>> collection.configName=storage-**conf<http://app03/solr/admin/collections?action=CREATE&name=storage&numShards=1&replicationFactor=2&collection.configName=storage-conf>
>>>>>
>>>>>>
>>>>>
>>>>> shard=shard1
>>>>>
>>>>> 5) Same command as above on the 3rd server to spin up another replica.
>>>>>
>>>>> This will spin up a new core and bind it to shard1 of the storage
>>>>> collection.
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> On Mon, Apr 8, 2013 at 9:34 AM, A.Eibner <a_eibner@yahoo.de> wrote:
>>>>>
>>>>>   Hi,
>>>>>>
>>>>>> I have a problem with setting up my solr cloud environment (on three
>>>>>> machines).
>>>>>> If I want to create my collections from scratch I do the following:
>>>>>>
>>>>>> *) Start ZooKeeper on all machines.
>>>>>>
>>>>>> *) Upload the configuration (on app02) for the collection via the
>>>>>> following command:
>>>>>>       zkcli.sh -cmd upconfig --zkhost
>>>>>> app01:4181,app02:4181,app03:****
>>>>>> 4181
>>>>>> --confdir config/solr/storage/conf/ --confname storage-conf
>>>>>>
>>>>>> *) Linking the configuration (on app02) via the following command:
>>>>>>       zkcli.sh -cmd linkconfig --collection storage --confname
>>>>>> storage-conf
>>>>>> --zkhost app01:4181,app02:4181,app03:****4181
>>>>>>
>>>>>> *) Start Tomcats (containing Solr) on app02,app03
>>>>>>
>>>>>> *) Create Collection via:
>>>>>> http://app03/solr/admin/****collections?action=CREATE&**<http://app03/solr/admin/**collections?action=CREATE&**>
>>>>>>
>>>>>> name=storage&numShards=1&****replicationFactor=2&**
>>>>>> collection.configName=storage-****conf<http://app03/solr/**
>>>>>> admin/collections?action=**CREATE&name=storage&numShards=**
>>>>>> 1&replicationFactor=2&**collection.configName=storage-**conf<http://app03/solr/admin/collections?action=CREATE&name=storage&numShards=1&replicationFactor=2&collection.configName=storage-conf>
>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>> This creates the replication of the shard on app02 and app03, but
>>>>>> neither
>>>>>> of them is marked as leader, both are marked as DOWN.
>>>>>> And after wards I can not access the collection.
>>>>>> In the browser I get:
>>>>>> "SEVERE: org.apache.solr.common.****SolrException: no servers hosting
>>>>>> shard:"
>>>>>>
>>>>>> In the log files the following error is present:
>>>>>> SEVERE: Error from shard: app02:9985/solr
>>>>>> org.apache.solr.common.****SolrException: Error CREATEing SolrCore
>>>>>> 'storage_shard1_replica1':
>>>>>>           at
>>>>>> org.apache.solr.client.solrj.****impl.HttpSolrServer.request(****
>>>>>> HttpSolrServer.java:404)
>>>>>>           at
>>>>>> org.apache.solr.client.solrj.****impl.HttpSolrServer.request(****
>>>>>> HttpSolrServer.java:181)
>>>>>>           at
>>>>>> org.apache.solr.handler.****component.HttpShardHandler$1.**
>>>>>> **
>>>>>> call(HttpShardHandler.java:****172)
>>>>>>           at
>>>>>> org.apache.solr.handler.****component.HttpShardHandler$1.**
>>>>>> **
>>>>>> call(HttpShardHandler.java:****135)
>>>>>>           at java.util.concurrent.****FutureTask$Sync.innerRun(**
>>>>>> FutureTask.java:334)
>>>>>>           at java.util.concurrent.****FutureTask.run(FutureTask.****
>>>>>> java:166)
>>>>>>           at java.util.concurrent.****Executors$RunnableAdapter.**
>>>>>> call(Executors.java:471)
>>>>>>           at java.util.concurrent.****FutureTask$Sync.innerRun(**
>>>>>> FutureTask.java:334)
>>>>>>           at java.util.concurrent.****FutureTask.run(FutureTask.****
>>>>>> java:166)
>>>>>>           at
>>>>>> java.util.concurrent.****ThreadPoolExecutor.runWorker(****
>>>>>> ThreadPoolExecutor.java:1110)
>>>>>>           at
>>>>>> java.util.concurrent.****ThreadPoolExecutor$Worker.run(****
>>>>>> ThreadPoolExecutor.java:603)
>>>>>>           at java.lang.Thread.run(Thread.****java:722)
>>>>>> Caused by: org.apache.solr.common.cloud.****ZooKeeperException:
>>>>>>           at org.apache.solr.core.****CoreContainer.registerInZk(**
>>>>>> CoreContainer.java:922)
>>>>>>           at org.apache.solr.core.****CoreContainer.registerCore(**
>>>>>> CoreContainer.java:892)
>>>>>>           at org.apache.solr.core.****CoreContainer.register(**
>>>>>> CoreContainer.java:841)
>>>>>>           at org.apache.solr.handler.admin.****CoreAdminHandler.**
>>>>>> handleCreateAction(****CoreAdminHandler.java:479)
>>>>>>           ... 19 more
>>>>>> Caused by: org.apache.solr.common.****SolrException: Error getting
>>>>>> leader
>>>>>> from zk for shard shard1
>>>>>>           at org.apache.solr.cloud.****ZkController.getLeader(**
>>>>>> ZkController.java:864)
>>>>>>           at org.apache.solr.cloud.****ZkController.register(**
>>>>>> ZkController.java:776)
>>>>>>           at org.apache.solr.cloud.****ZkController.register(**
>>>>>> ZkController.java:727)
>>>>>>           at org.apache.solr.core.****CoreContainer.registerInZk(**
>>>>>> CoreContainer.java:908)
>>>>>>           ... 22 more
>>>>>> Caused by: java.lang.****InterruptedException: sleep interrupted
>>>>>>           at java.lang.Thread.sleep(Native Method)
>>>>>>           at org.apache.solr.cloud.****ZkController.getLeaderProps(**
>>>>>> ZkController.java:905)
>>>>>>           at org.apache.solr.cloud.****ZkController.getLeaderProps(**
>>>>>> ZkController.java:875)
>>>>>>           at org.apache.solr.cloud.****ZkController.getLeader(**
>>>>>> ZkController.java:839)
>>>>>>           ... 25 more
>>>>>>
>>>>>> I have attached a minimal set of configuration files which are
>>>>>> needed to
>>>>>> replicate this error, also containing the log files for the commands
>>>>>> I have
>>>>>> run in the order above.
>>>>>>
>>>>>> I use the following versions of:
>>>>>> Solr: 4.2.1
>>>>>> ZooKeeper: 3.4.5
>>>>>> Tomcat 7.0.27
>>>>>>
>>>>>> app01: ZooKeeper
>>>>>> app02: ZooKeeper, Solr (in Tomcat)
>>>>>> app03: ZooKeeper, Solr (in Tomcat)
>>>>>>
>>>>>> The same procedure does work if I use Solr 4.0, but the BUG (
>>>>>> https://issues.apache.org/****jira/browse/SOLR-3939<https://issues.apache.org/**jira/browse/SOLR-3939>
>>>>>>
>>>>>> <https://**issues.apache.org/jira/browse/**SOLR-3939<https://issues.apache.org/jira/browse/SOLR-3939>
>>>>>>
>>>>>>>
>>>>>>
>>>>>> ) prevents me from using 4.0 in this scenario.
>>>>>>
>>>>>> If you need anything else, please just say so.
>>>>>>
>>>>>> Thanks for your help
>>>>>>
>>>>>> Kind Regards
>>>>>> Alexander
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>
>>
>>
>
>


Mime
View raw message