hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinod K V (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-4830) Have end to end tests based on MiniMRCluster to verify that queue capacities are honoured.
Date Thu, 11 Dec 2008 05:36:44 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-4830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12655521#action_12655521

Vinod K V commented on HADOOP-4830:

This particular JIRA should address the following:
 - Write/improve utilities that will help the test-cases. This includes
      -- enhancing org.apache.hadoop.mapred.UtilsForTests.Waiting{Mapper|Reducer} so that
the tasks that can finish by signalling is controlled and is a subset of all the tasks.
      -- having a utility that makes a test to block and wait for a particular number of tasks
to be running and occupying a cluster's slots.
      -- setting up a way to configure the capacity scheduler for the tests.
 - Automate the tests related to queue capacities: submit jobs to different queues simultaneously
and see that capacities are honored

> Have end to end tests based on MiniMRCluster to verify that queue capacities are honoured.
> ------------------------------------------------------------------------------------------
>                 Key: HADOOP-4830
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4830
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: contrib/capacity-sched
>            Reporter: Vinod K V
> At present, we only have unit tests that make use of FakeTaskManager and that only test
the proper functionality of capacity scheduler in isolation. Many issues unearthed recently
proved that this is not enough and that it is required to have end-to-end tests so that real
JT is brought into the picture and with that the interaction of the scheduler with JT. This
issue along with few other related jiras should automate and replace the end-to-end tests
that are now manually done by QA, using MiniMRCluster.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message