hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tassapol Athiapinya (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2297) Preemption can hang in corner case by not allowing any task container to proceed.
Date Wed, 16 Jul 2014 04:07:04 GMT

    [ https://issues.apache.org/jira/browse/YARN-2297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14063099#comment-14063099
] 

Tassapol Athiapinya commented on YARN-2297:
-------------------------------------------

bq. Are there realistic configurations where this creates a problem? If a queue is configured
with less than a container's capacity, what is the intent?
Sorry, I don't have real world scenario yet. The issue is found during system test for a case
when AM is preempted ([YARN-2074]). This configuration can simulate that scenario in controllable
manner.

> Preemption can hang in corner case by not allowing any task container to proceed.
> ---------------------------------------------------------------------------------
>
>                 Key: YARN-2297
>                 URL: https://issues.apache.org/jira/browse/YARN-2297
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: capacityscheduler
>    Affects Versions: 2.5.0
>            Reporter: Tassapol Athiapinya
>            Assignee: Wangda Tan
>            Priority: Critical
>
> Preemption can cause hang issue in single-node cluster. Only AMs run. No task container
can run.
> h3. queue configuration
> Queue A/B has 1% and 99% respectively. 
> No max capacity.
> h3. scenario
> Turn on preemption. Configure 1 NM with 4 GB of memory. Use only 2 apps. Use 1 user.
> Submit app 1 to queue A. AM needs 2 GB. There is 1 task that needs 2 GB. Occupy entire
cluster.
> Submit app 2 to queue B. AM needs 2 GB. There are 3 tasks that need 2 GB each.
> Instead of entire app 1 preempted, app 1 AM will stay. App 2 AM will launch. No task
of either app can proceed. 
> h3. commands
> /usr/lib/hadoop/bin/hadoop jar /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar
randomtextwriter "-Dmapreduce.map.memory.mb=2000" "-Dyarn.app.mapreduce.am.command-opts=-Xmx1800M"
"-Dmapreduce.randomtextwriter.bytespermap=2147483648" "-Dmapreduce.job.queuename=A" "-Dmapreduce.map.maxattempts=100"
"-Dmapreduce.am.max-attempts=1" "-Dyarn.app.mapreduce.am.resource.mb=2000" "-Dmapreduce.map.java.opts=-Xmx1800M"
"-Dmapreduce.randomtextwriter.mapsperhost=1" "-Dmapreduce.randomtextwriter.totalbytes=2147483648"
dir1
> /usr/lib/hadoop/bin/hadoop jar /usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-tests.jar
sleep "-Dmapreduce.map.memory.mb=2000" "-Dyarn.app.mapreduce.am.command-opts=-Xmx1800M" "-Dmapreduce.job.queuename=B"
"-Dmapreduce.map.maxattempts=100" "-Dmapreduce.am.max-attempts=1" "-Dyarn.app.mapreduce.am.resource.mb=2000"
"-Dmapreduce.map.java.opts=-Xmx1800M" -m 1 -r 0 -mt 4000  -rt 0



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message