hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matteo Bertozzi (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-4391) Add ability to start RS as root and call mlockall
Date Wed, 13 Jun 2012 19:02:42 GMT

    [ https://issues.apache.org/jira/browse/HBASE-4391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13294622#comment-13294622
] 

Matteo Bertozzi commented on HBASE-4391:
----------------------------------------

Accumulo has a "tserver.memory.lock" property used to enable mlock in TabletServer. At startup
the property is read and if true mlockall() is called.

Different approach but the result is the same... the Todd proposed solution is external from
the RegionServer code (and maybe can be integrated in hadoop-common to be used by datanode
& co without changing the hdfs code), the accumulo one is integrated in the tablet code...
                
> Add ability to start RS as root and call mlockall
> -------------------------------------------------
>
>                 Key: HBASE-4391
>                 URL: https://issues.apache.org/jira/browse/HBASE-4391
>             Project: HBase
>          Issue Type: New Feature
>          Components: regionserver
>    Affects Versions: 0.94.0
>            Reporter: Todd Lipcon
>            Assignee: Todd Lipcon
>             Fix For: 0.96.0
>
>         Attachments: HBASE-4391-v0.patch
>
>
> A common issue we've seen in practice is that users oversubscribe their region servers
with too many MR tasks, etc. As soon as the machine starts swapping, the RS grinds to a halt,
loses ZK session, aborts, etc.
> This can be combatted by starting the RS as root, calling mlockall(), and then setuid
down to the hbase user. We should not require this, but we should provide it as an option.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message