mesos-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Charles Reiss (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MESOS-204) enable Frameworks level disk IO bandwidth support
Date Tue, 05 Jun 2012 03:08:23 GMT

    [ https://issues.apache.org/jira/browse/MESOS-204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13289108#comment-13289108
] 

Charles Reiss commented on MESOS-204:
-------------------------------------

It would probably make more sense to use the cgroups blkio controller (http://www.kernel.org/doc/Documentation/cgroups/blkio-controller.txt),
assuming you'll have a recent enough kernel. Network prioritization can probably be done similarly.
This probably just hasn't been a big priority for people because there are nastier issues
with isolation, e.g. MESOS-47.

For I/O isolation, one issue is that HDFS (or other DFS) will probably create priority inversion
issues in most real installations. It's not clear how to deal with this problem.
                
> enable Frameworks level disk IO bandwidth support
> -------------------------------------------------
>
>                 Key: MESOS-204
>                 URL: https://issues.apache.org/jira/browse/MESOS-204
>             Project: Mesos
>          Issue Type: Brainstorming
>            Reporter: Qinghe Jin
>
> I am considering to add Frameworks level disk IO bandwidth support to mesos,which behaves
like ionice on the single node,but this time it‘s in multi-nodes。I believe this kind
of disk QoS support will be more user friendly。My initial idea is to allow user to use an
ioprio_set like api to set the io priority when they commit their job. At the same time, here
may need some tools to display the disk IO usage per node/container on the webui.
> I have read the mesos paper carefully and I found that in the comment,it mentioned
that in the future it will support disk and network bandwidth control。But,in my opinion,disk
IO bandwidth is more feasible for it has more locality,and network bandwidth control may
be more difficult for the complexity of the network environment。But I don't know why is
there nobody going to add this feature。Is it useless?Or not feasible?Or just not interested?
> For this feature may need a lot of work,I‘d like to listen to your opinions before
I start to work on it。Anybody who have any questions ,suggestions or ideas, please tell
me and I appreciate it very much,Thanks!

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

Mime
View raw message