hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hadoop QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-9194) RPC Support for QoS
Date Sat, 23 Mar 2013 03:37:19 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-9194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13611544#comment-13611544
] 

Hadoop QA commented on HADOOP-9194:
-----------------------------------

{color:green}+1 overall{color}.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12575148/HADOOP-9194-v2.patch
  against trunk revision .

    {color:green}+1 @author{color}.  The patch does not contain any @author tags.

    {color:green}+1 tests included{color}.  The patch appears to include 1 new or modified
test files.

    {color:green}+1 tests included appear to have a timeout.{color}

    {color:green}+1 javac{color}.  The applied patch does not increase the total number of
javac compiler warnings.

    {color:green}+1 javadoc{color}.  The javadoc tool did not generate any warning messages.

    {color:green}+1 eclipse:eclipse{color}.  The patch built with eclipse:eclipse.

    {color:green}+1 findbugs{color}.  The patch does not introduce any new Findbugs (version
1.3.9) warnings.

    {color:green}+1 release audit{color}.  The applied patch does not increase the total number
of release audit warnings.

    {color:green}+1 core tests{color}.  The patch passed unit tests in hadoop-common-project/hadoop-common.

    {color:green}+1 contrib tests{color}.  The patch passed contrib unit tests.

Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/2357//testReport/
Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/2357//console

This message is automatically generated.
                
> RPC Support for QoS
> -------------------
>
>                 Key: HADOOP-9194
>                 URL: https://issues.apache.org/jira/browse/HADOOP-9194
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: ipc
>    Affects Versions: 2.0.2-alpha
>            Reporter: Luke Lu
>         Attachments: HADOOP-9194.patch, HADOOP-9194-v2.patch
>
>
> One of the next frontiers of Hadoop performance is QoS (Quality of Service). We need
QoS support to fight the inevitable "buffer bloat" (including various queues, which are probably
necessary for throughput) in our software stack. This is important for mixed workload with
different latency and throughput requirements (e.g. OLTP vs OLAP, batch and even compaction
I/O) against the same DFS.
> Any potential bottleneck will need to be managed by QoS mechanisms, starting with RPC.

> How about adding a one byte DS (differentiated services) field (a la the 6-bit DS field
in IP header) in the RPC header to facilitate the QoS mechanisms (in separate JIRAs)? The
byte at a fixed offset (how about 0?) of the header is helpful for implementing high performance
QoS mechanisms in switches (software or hardware) and servers with minimum decoding effort.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message