hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Girish Lingappa <glinga...@pivotal.io>
Subject Re: Error executing job in YARN. Exception Shell$ExitCodeException
Date Thu, 16 Oct 2014 00:08:25 GMT
Hi Goritz

 It is most likely a failure of the application you are trying to run and
you can find the exact cause of failure in your logs. To find these logs
check your yarn-site.xml for *yarn.log-aggregation-enable.*

If *yarn.log-aggregation-enable *is set to true then your logs should be on
hdfs under /<BASE_DIR>/<user-who-ran-this>/<application-id> where
<BASE_DIR> is defined in property *yarn.nodemanager.remote-app-log-dir, *again
in yarn-site.xml

If *yarn.log-aggregation-enable *is disabled try looking for the logs under
each nodemanager that ran the tasks. The location for this local dir is
configured as property *yarn.nodemanager.log-dirs *in yarn-site.xml

It is also possible to check these logs on the RM UI, and the URL to track
is shown when you launch this application.

Thanks
Girish



On Wed, Oct 15, 2014 at 5:57 AM, Brahma Reddy Battula <
brahmareddy.battula@huawei.com> wrote:

> Hi gortiz
>
> Please have a look at application master logs(you can get RM UI or JHS (if
> aggeration enabled) or yarn-nodemanger-logs-dir (if aggeration is disabled)
> ) and Nodemanager logs to get the exact cause..
>
>
>
> Thanks & Regards
> Brahma Reddy Battula
>
>
>
>
> ________________________________________
> From: gortiz [gortiz@pragsis.com]
> Sent: Wednesday, October 15, 2014 5:25 PM
> To: user@hadoop.apache.org
> Subject: Error executing job in YARN. Exception Shell$ExitCodeException
>
> I'm trying to execute a work in YARN but I get an error. I have checked
> the yarn-site.xml, the classpath seems to be alright.
> I read https://issues.apache.org/jira/browse/YARN-1473 as well, but it
> didn't work to me either.
>
> Container for appattempt_1413373500815_0001_000002 exited with exitCode:
> 1 due to: Exception from container-launch:
> org.apache.hadoop.util.Shell$ExitCodeException:
> org.apache.hadoop.util.Shell$ExitCodeException:
>      at org.apache.hadoop.util.Shell.runCommand(Shell.java:511)
>      at org.apache.hadoop.util.Shell.run(Shell.java:424)
>      at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:656)
>      at
>
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
>      at
>
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:300)
>      at
>
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:81)
>      at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>      at
>
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>      at
>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>      at java.lang.Thread.run(Thread.java:744)
>
>
> What else could it be happened?
> AVISO CONFIDENCIAL\nEste correo y la información contenida o adjunta al
> mismo es privada y confidencial y va dirigida exclusivamente a su
> destinatario. Pragsis informa a quien pueda haber recibido este correo por
> error que contiene información confidencial cuyo uso, copia, reproducción o
> distribución está expresamente prohibida. Si no es Vd. el destinatario del
> mismo y recibe este correo por error, le rogamos lo ponga en conocimiento
> del emisor y proceda a su eliminación sin copiarlo, imprimirlo o utilizarlo
> de ningún modo.\nCONFIDENTIALITY WARNING.\nThis message and the information
> contained in or attached to it are private and confidential and intended
> exclusively for the addressee. Pragsis informs to whom it may receive it in
> error that it contains privileged information and its use, copy,
> reproduction or distribution is prohibited. If you are not an intended
> recipient of this E-mail, please notify the sender, delete it and do not
> read, act upon, print, disclose, c!
> opy, reta
>  in or redistribute any portion of this E-mail.
>


On Wed, Oct 15, 2014 at 5:57 AM, Brahma Reddy Battula <
brahmareddy.battula@huawei.com> wrote:

> Hi gortiz
>
> Please have a look at application master logs(you can get RM UI or JHS (if
> aggeration enabled) or yarn-nodemanger-logs-dir (if aggeration is disabled)
> ) and Nodemanager logs to get the exact cause..
>
>
>
> Thanks & Regards
> Brahma Reddy Battula
>
>
>
>
> ________________________________________
> From: gortiz [gortiz@pragsis.com]
> Sent: Wednesday, October 15, 2014 5:25 PM
> To: user@hadoop.apache.org
> Subject: Error executing job in YARN. Exception Shell$ExitCodeException
>
> I'm trying to execute a work in YARN but I get an error. I have checked
> the yarn-site.xml, the classpath seems to be alright.
> I read https://issues.apache.org/jira/browse/YARN-1473 as well, but it
> didn't work to me either.
>
> Container for appattempt_1413373500815_0001_000002 exited with exitCode:
> 1 due to: Exception from container-launch:
> org.apache.hadoop.util.Shell$ExitCodeException:
> org.apache.hadoop.util.Shell$ExitCodeException:
>      at org.apache.hadoop.util.Shell.runCommand(Shell.java:511)
>      at org.apache.hadoop.util.Shell.run(Shell.java:424)
>      at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:656)
>      at
>
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
>      at
>
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:300)
>      at
>
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:81)
>      at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>      at
>
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>      at
>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>      at java.lang.Thread.run(Thread.java:744)
>
>
> What else could it be happened?
> AVISO CONFIDENCIAL\nEste correo y la información contenida o adjunta al
> mismo es privada y confidencial y va dirigida exclusivamente a su
> destinatario. Pragsis informa a quien pueda haber recibido este correo por
> error que contiene información confidencial cuyo uso, copia, reproducción o
> distribución está expresamente prohibida. Si no es Vd. el destinatario del
> mismo y recibe este correo por error, le rogamos lo ponga en conocimiento
> del emisor y proceda a su eliminación sin copiarlo, imprimirlo o utilizarlo
> de ningún modo.\nCONFIDENTIALITY WARNING.\nThis message and the information
> contained in or attached to it are private and confidential and intended
> exclusively for the addressee. Pragsis informs to whom it may receive it in
> error that it contains privileged information and its use, copy,
> reproduction or distribution is prohibited. If you are not an intended
> recipient of this E-mail, please notify the sender, delete it and do not
> read, act upon, print, disclose, c!
> opy, reta
>  in or redistribute any portion of this E-mail.
>

Mime
View raw message