bookkeeper-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sijie Guo <si...@apache.org>
Subject Re: BOOKKEEPER-878
Date Sat, 19 Dec 2015 01:30:17 GMT
On Fri, Dec 18, 2015 at 7:26 AM, Enrico Olivelli - Diennea <
enrico.olivelli@diennea.com> wrote:

> Thank you very much
>
>
>
> We got a work-around for our problem. Our bookies could not run Compaction
> due to errors on listing /ledgers.
>
>
>
> It was not possible to scan list of ledgers in any way because of
> zookeeper limits (see https://issues.apache.org/jira/browse/BOOKKEEPER-39
> and similar issues)
>
>
>
> Our work-around is to scan ledgers list doing a “blind” ledgerId scan from
> 1 to 1.700.000 in order to find existing ledgerIDs and then dropping ledger
> which were no more in use.
>
> We found that a procedure was “leaking” ledgers, it was never dropping
> ledgers, so our system got overhelmed.
>
>
>
> Once the clean up  operation completed the Compation run instantly and we
> released several GBs of space on bookies
>
>
>
> Now the list of ledgers is really more affordable by FlatLedgersManager
> and so we have some more time
>
>
>
> We would like to migrate to HierarchicalLederManager anyway in order not
> to have such problems in the future, provided that our systems are growing
> and bookkeeper is one of the fundamental pieces or our infrastructure
>

Good to hear that. That's a very impression action from your description.
Let me work with you to complete the migration from FlatLedgerManager to
HierarchicalLedgerManager.


>
>
> -- Enrico
>
>
>
> *Da:* Sijie Guo [mailto:sijie@apache.org]
> *Inviato:* giovedì 17 dicembre 2015 19:41
> *A:* user@bookkeeper.apache.org
> *Oggetto:* Re: BOOKKEEPER-878
>
>
>
> Hello Enrico:
>
> Sorry for the delays. Trying to get to it today.
>
> - Sijie
>
>
>
> On Thu, Dec 17, 2015 at 3:54 AM, Enrico Olivelli - Diennea <
> enrico.olivelli@diennea.com> wrote:
>
> Hi,
>
> Any news on the switch from FlagLedgerManager to HierarchicalLedgerManager
> ?
>
> https://issues.apache.org/jira/browse/BOOKKEEPER-878
>
>
>
> we deployed today in production systems Bookkeeper 4.3.2 and it is working
> very fine
>
>
>
> we hope that a switch is possible because our production systems Bookies
> are continuing to eat disk space, because /ledgers is huge and
> GarbageCollector cannot perform its work
>
>
>
> Thank you very much
>
>
>
>
>
> *Enrico Olivelli*
> Software Development Manager @Diennea
> Tel.: (+39) 0546 066100 - Int. 925
> Viale G.Marconi 30/14 - 48018 Faenza (RA)
>
> MagNews - E-mail Marketing Solutions
> http://www.magnews.it
> Diennea - Digital Marketing Solutions
> http://www.diennea.com
>
>
>
>
> ------------------------------
>
> Iscriviti alla nostra newsletter per rimanere aggiornato su digital ed
> email marketing! http://www.magnews.it/newsletter/
>
> The information in this email is confidential and may be legally
> privileged. If you are not the intended recipient please notify the sender
> immediately and destroy this email. Any unauthorized, direct or indirect,
> disclosure, copying, storage, distribution or other use is strictly
> forbidden.
>
>
>
> ------------------------------
> Iscriviti alla nostra newsletter per rimanere aggiornato su digital ed
> email marketing! http://www.magnews.it/newsletter/
>
> The information in this email is confidential and may be legally
> privileged. If you are not the intended recipient please notify the sender
> immediately and destroy this email. Any unauthorized, direct or indirect,
> disclosure, copying, storage, distribution or other use is strictly
> forbidden.
>

Mime
View raw message