lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Elaine Cario (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SOLR-4793) Solr Cloud can't upload large config files ( > 1MB) to Zookeeper
Date Fri, 20 Jun 2014 16:00:26 GMT

    [ https://issues.apache.org/jira/browse/SOLR-4793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14038948#comment-14038948
] 

Elaine Cario commented on SOLR-4793:
------------------------------------

Yago - we have partial success!  I added the file as you did, but for some reason the parameter
was still not being added to the zookeeper startup (checked PID using ps -ww -fp PID, and
didn't see it).

So, for the moment I modified the zkServer.sh to just add the param directly to the java startup,
and that seemed to work - everything started up with the big files.  Now I just need to figure
out what's going wrong with the scripting, but that's just some investigation in my part.
 I'm sure I did something wrong there.

Thanks so much for your help!!  This has been bugging me for weeks.



> Solr Cloud can't upload large config files ( > 1MB)  to Zookeeper
> -----------------------------------------------------------------
>
>                 Key: SOLR-4793
>                 URL: https://issues.apache.org/jira/browse/SOLR-4793
>             Project: Solr
>          Issue Type: Improvement
>            Reporter: Son Nguyen
>
> Zookeeper set znode size limit to 1MB by default. So we can't start Solr Cloud with some
large config files, like synonyms.txt.
> Jan H√łydahl has a good idea:
> "SolrCloud is designed with an assumption that you should be able to upload your whole
disk-based conf folder into ZK, and that you should be able to add an empty Solr node to a
cluster and it would download all config from ZK. So immediately a splitting strategy automatically
handled by ZkSolresourceLoader for large files could be one way forward, i.e. store synonyms.txt
as e.g. __001_synonyms.txt __002_synonyms.txt...."



--
This message was sent by Atlassian JIRA
(v6.2#6252)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message