accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Christopher Tubbs (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ACCUMULO-3793) enable numa memory interleaving
Date Mon, 11 May 2015 16:32:00 GMT

    [ https://issues.apache.org/jira/browse/ACCUMULO-3793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538128#comment-14538128
] 

Christopher Tubbs commented on ACCUMULO-3793:
---------------------------------------------

It's not a kernel parameter. There's a userspace utility, called {{numactl}} which negotiates
the process' memory policy during execution. It's executed like {{time}} or {{nice}} or {{watch}},
by following {{numactl}} with the actual command to execute.

Example:

{code}
numactl --interleave=all $JAVA_CMD org.apache.accumulo.start.Main $@
{code}

Of course, {{numactl}} has to actually be installed on the system, and we could additionally
require a flag to be set before we prefix our command (if we didn't want to execute with {{numactl}}
by default... though I can't see much of a downside). But, the main point is that commands
like {{start-all.sh}} would have to manually modified if we didn't provide some mechanism
to call {{numactl}} in the script out-of-the-box.

> enable numa memory interleaving
> -------------------------------
>
>                 Key: ACCUMULO-3793
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-3793
>             Project: Accumulo
>          Issue Type: Improvement
>          Components: scripts
>         Environment: Large VM
>            Reporter: Eric Newton
>            Assignee: Eric Newton
>             Fix For: 1.6.3, 1.8.0, 1.7.1
>
>
> In this [fine article|http://tinyurl.com/m8lt7v2] it is recommended that NUMA optimizations
be disabled. This seems to be exactly our use-case as well, and we have been struggling with
ways to manage the linux page cache on large production systems.  Do this by default in the
start scripts.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message