accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Elser (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ACCUMULO-2787) Accumulo too strict about max files
Date Tue, 10 Jun 2014 14:34:02 GMT

    [ https://issues.apache.org/jira/browse/ACCUMULO-2787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14026506#comment-14026506
] 

Josh Elser commented on ACCUMULO-2787:
--------------------------------------

I would say....

-200- tablets per server -> 500. A splittable metadata table allows you to have lots of
tablets per server. While, yes, we know that this isn't completely optimal, I'm sure it happens
because dealing with more tablets than is "ideal" is much nicer than constantly trying to
merge tablets together to get to that number

-1000- files per tserver -> What about 10 files per tablet with 500 tablets per tserver
gives us 5000 files

-10- concurrent scanners is really low for 1k nodes (you'd hit that with metadata scans alone)
-> 500 at least (and that's mostly a guess)

-5- accumulo.metadata tablets -> Probably more like 30 (but not really a big change in
the big picture)

Even so, at most, this is maybe 5k more than what you outlined.

> Accumulo too strict about max files
> -----------------------------------
>
>                 Key: ACCUMULO-2787
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-2787
>             Project: Accumulo
>          Issue Type: Bug
>          Components: start
>    Affects Versions: 1.5.1, 1.6.0
>            Reporter: Mike Drob
>              Labels: newbie
>
> Accumulo is very aggressive about asking for 65536 max open files, when really something
like 10k is probably fine.
> We should lower the WARN threshold.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message