lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Elaine Cario (JIRA)" <>
Subject [jira] [Commented] (SOLR-4793) Solr Cloud can't upload large config files ( > 1MB) to Zookeeper
Date Fri, 20 Jun 2014 16:00:26 GMT


Elaine Cario commented on SOLR-4793:

Yago - we have partial success!  I added the file as you did, but for some reason the parameter
was still not being added to the zookeeper startup (checked PID using ps -ww -fp PID, and
didn't see it).

So, for the moment I modified the to just add the param directly to the java startup,
and that seemed to work - everything started up with the big files.  Now I just need to figure
out what's going wrong with the scripting, but that's just some investigation in my part.
 I'm sure I did something wrong there.

Thanks so much for your help!!  This has been bugging me for weeks.

> Solr Cloud can't upload large config files ( > 1MB)  to Zookeeper
> -----------------------------------------------------------------
>                 Key: SOLR-4793
>                 URL:
>             Project: Solr
>          Issue Type: Improvement
>            Reporter: Son Nguyen
> Zookeeper set znode size limit to 1MB by default. So we can't start Solr Cloud with some
large config files, like synonyms.txt.
> Jan H√łydahl has a good idea:
> "SolrCloud is designed with an assumption that you should be able to upload your whole
disk-based conf folder into ZK, and that you should be able to add an empty Solr node to a
cluster and it would download all config from ZK. So immediately a splitting strategy automatically
handled by ZkSolresourceLoader for large files could be one way forward, i.e. store synonyms.txt
as e.g. __001_synonyms.txt __002_synonyms.txt...."

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message