hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matteo Bertozzi (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-4391) Add ability to start RS as root and call mlockall
Date Wed, 06 Jun 2012 18:09:23 GMT

    [ https://issues.apache.org/jira/browse/HBASE-4391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13290307#comment-13290307
] 

Matteo Bertozzi commented on HBASE-4391:
----------------------------------------

todd's code looks good to me.

One way to avoid using root to start the RS is adding hbase user to /etc/security/limits.d/
{code}echo "$USER - memlock $MAX_MEMLOCK_SIZE" >/etc/security/limits.d/$USER.conf{code}

If this will be integrated in hbase, do you want to force everyone to use root or add hbase
user in limits.d to start RS? or we can add some --no-swap flag to region server start script?
                
> Add ability to start RS as root and call mlockall
> -------------------------------------------------
>
>                 Key: HBASE-4391
>                 URL: https://issues.apache.org/jira/browse/HBASE-4391
>             Project: HBase
>          Issue Type: New Feature
>          Components: regionserver
>    Affects Versions: 0.94.0
>            Reporter: Todd Lipcon
>            Assignee: Todd Lipcon
>             Fix For: 0.96.0
>
>
> A common issue we've seen in practice is that users oversubscribe their region servers
with too many MR tasks, etc. As soon as the machine starts swapping, the RS grinds to a halt,
loses ZK session, aborts, etc.
> This can be combatted by starting the RS as root, calling mlockall(), and then setuid
down to the hbase user. We should not require this, but we should provide it as an option.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message