hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Abhishek Modi (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (YARN-8663) Opportunistic Container property "mapreduce.job.num-opportunistic-maps-percent" is throwing wrong exception at wrong sequence
Date Tue, 21 Aug 2018 17:18:00 GMT

     [ https://issues.apache.org/jira/browse/YARN-8663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Abhishek Modi reassigned YARN-8663:
-----------------------------------

    Assignee: Abhishek Modi

> Opportunistic Container property "mapreduce.job.num-opportunistic-maps-percent" is throwing
wrong exception at wrong sequence
> -----------------------------------------------------------------------------------------------------------------------------
>
>                 Key: YARN-8663
>                 URL: https://issues.apache.org/jira/browse/YARN-8663
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: yarn
>    Affects Versions: 3.1.1
>         Environment: Secure Installation with Kerberos ON.
>            Reporter: Akshay Agarwal
>            Assignee: Abhishek Modi
>            Priority: Major
>
> Pre-requisites:
> {code:java}
> 1. Install HA cluster.
> 2.Set yarn.nodemanager.opportunistic-containers-max-queue-length=(positive integer value)[NodeManager->yarnsite.xml]
> 3. Set yarn.resourcemanager.opportunistic-container-allocation.enabled= true[ResourceManager->yarnsite.xml]
> {code}
>  
> Steps to reproduce:
> {code:java}
> 1.Keep All NodeManagers Up
> 2. Submit a job with -Dmapreduce.job.num-opportunistic-maps-percent="abh" or "2.5" 
> {code}
> Expected Result: 
> {code:java}
> Should through an Exception stating "NumberFormatException" before writing the input
for mappers.
> {code}
> Log Details:
> {code:java}
> 2018-08-14 18:15:54,049 INFO mapreduce.Job:  map 0% reduce 0%
> 2018-08-14 18:15:54,069 INFO mapreduce.Job: Job job_1534236847054_0005 failed with state
FAILED due to: Application application_1534236847054_0005 failed 2 times due to AM Container
for appattempt_1534236847054_0005_000002 exited with  exitCode: 1
> Failing this attempt.Diagnostics: [2018-08-14 18:15:53.110]Exception from container-launch.
> Container id: container_e31_1534236847054_0005_02_000001
> Exit code: 1
> [2018-08-14 18:15:53.113]Container exited with a non-zero exit code 1. Error file: prelaunch.err.
> Last 4096 bytes of prelaunch.err :
> Last 4096 bytes of stderr :
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option UseSplitVerifier; support
was removed in 8.0
> Aug 14, 2018 6:15:51 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory
register
> INFO: Registering org.apache.hadoop.mapreduce.v2.app.webapp.JAXBContextResolver as a
provider class
> Aug 14, 2018 6:15:51 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory
register
> INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider
class
> Aug 14, 2018 6:15:51 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory
register
> INFO: Registering org.apache.hadoop.mapreduce.v2.app.webapp.AMWebServices as a root resource
class
> Aug 14, 2018 6:15:51 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
> INFO: Initiating Jersey application, version 'Jersey: 1.19 02/11/2015 03:25 AM'
> Aug 14, 2018 6:15:51 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory
getComponentProvider
> INFO: Binding org.apache.hadoop.mapreduce.v2.app.webapp.JAXBContextResolver to GuiceManagedComponentProvider
with the scope "Singleton"
> Aug 14, 2018 6:15:52 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory
getComponentProvider
> INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider
with the scope "Singleton"
> Aug 14, 2018 6:15:52 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory
getComponentProvider
> INFO: Binding org.apache.hadoop.mapreduce.v2.app.webapp.AMWebServices to GuiceManagedComponentProvider
with the scope "PerRequest"
> log4j:WARN No appenders could be found for logger (org.apache.hadoop.mapreduce.v2.app.MRAppMaster).
> log4j:WARN Please initialize the log4j system properly.
> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message