accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Busbey (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ACCUMULO-2787) Accumulo too strict about max files
Date Tue, 10 Jun 2014 14:28:01 GMT

    [ https://issues.apache.org/jira/browse/ACCUMULO-2787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14026493#comment-14026493
] 

Sean Busbey commented on ACCUMULO-2787:
---------------------------------------

that looks like the same set of factors [~mdrob] and I came up with.

How about we make it configurable (for when people make larger clusters) and go with:

* 1000 nodes
* ~200 tablets per server
* 1000 files making up the tablets on each server (across all tablets, not per)
* 10 concurrent scanners
* 1000 concurrent bulk load files
* 5 accumulo.metadata tablets

where does that put us? ~20k?

> Accumulo too strict about max files
> -----------------------------------
>
>                 Key: ACCUMULO-2787
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-2787
>             Project: Accumulo
>          Issue Type: Bug
>          Components: start
>    Affects Versions: 1.5.1, 1.6.0
>            Reporter: Mike Drob
>              Labels: newbie
>
> Accumulo is very aggressive about asking for 65536 max open files, when really something
like 10k is probably fine.
> We should lower the WARN threshold.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message