manifoldcf-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From lalit jangra <lalit.j.jan...@gmail.com>
Subject Re: Zookeeper configured MCF not working in production mode
Date Tue, 16 Sep 2014 11:21:12 GMT
Hello,

To restrain zookeeper from taking too much disk space, use below
parameters. These will help to purge extra data one may not need.

autopurge.snapRetainCount=3 : default value
autopurge.purgeInterval=1: default value

Feel free to update as per needs.

Regards.

On Tue, Sep 16, 2014 at 3:46 PM, Karl Wright <daddywri@gmail.com> wrote:

> Hi Erlend,
>
> The zookeeper configuration supplied will likely fill up your disk with
> zookeeper synch data, because the parameters that control the cleanup of
> that data are not properly set up for long-term execution.
>
> Graeme Seaton would be the best resource for using Zookeeper properly;
> he's on this list and I've cc'd him directly as well.
>
> Karl
>
>
> On Tue, Sep 16, 2014 at 5:06 AM, Erlend GarĂ¥sen <e.f.garasen@usit.uio.no>
> wrote:
>
>> On 16.09.14 10:53, lalit jangra wrote:
>>
>>> Hi Erlend,
>>>
>>> Can you please elaborate on how you have configured zookeeper based
>>> synchronization, is it in stand alone mode or clustered mode? How many
>>> zookeeper nodes are you running for each of node and how many agents are
>>> you running?
>>>
>>
>> I'm not very familiar with Zookeeper, so I have just followed the
>> examples inside the multiprocess-zk-example folder, i.e.:
>> $MCF_HOME/../runzookeeper.sh > /dev/null 2>&1 &
>>         # Reading global properties:
>>         $MCF_HOME/../setglobalproperties.sh > /dev/null 2>&1 &
>>         # Starting Agent process:
>>         $MCF_HOME/processes/executecommand.sh
>> org.apache.manifoldcf.agents.AgentRun \
>>         1>>$LOGDIR/mcf_agent.stdout.log 2>>$LOGDIR/mcf_agent.stderr.log
>> & pid=$!
>>
>> The above lines are from my startup script. I see now that I haven't
>> specified "-Dorg.apache.manifoldcf.processid=A", I'm not sure this is
>> important, but I can of course try to include that into my script and
>> restart everything.
>>
>> So to the question about how many zookeeper nodes I'm using, the answer
>> is one. The same applies to the number of running agents.
>>
>> Erlend
>>
>
>


-- 
Regards,
Lalit.

Mime
View raw message