hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From xeonmailinglist-gmail <xeonmailingl...@gmail.com>
Subject Re: Fwd: Re: can't submit a job
Date Thu, 28 May 2015 15:13:57 GMT
I have found why I couldn’t access the container. I needed to have in 
|yarn-site.xml| the property:

|<property> <name>yarn.log.server.url</name> <value>http://192.168.56.101:19888/jobhistory/logs/</value>
</property>
|

On 05/28/2015 04:01 PM, xeonmailinglist-gmail wrote:

> If I click in the logs link, I get the error. So it seems that my job 
> isn't launching and the container aren't working. I need to fix both 
> errors. Any suggestion?
>
> ```
>
>
>   Failed redirect for container_1432817967879_0003_01_000001
>
>
>       ResourceManager
>
>   * RM Home <http://hadoop-coc-1:8088/>
>
>
>       NodeManager
>
>
>       Tools
>
> 	
>
>
>   Failed while trying to construct the redirect url to the log server.
>   Log Server url may not be configured
>
>
>   java.lang.Exception: Unknown container. Container either has not
>   started or has already completed or doesn't belong to this node at all.
>
>
>
> ```
>
> On 05/28/2015 03:59 PM, xeonmailinglist-gmail wrote:
>>
>> The error that I got is [1], but I still don’t understand why I get 
>> this error. I couldn’t find more detail about it. Any suggestion?
>>
>> [1]
>>
>> |
>> Application application_1432817967879_0003 failed 2 times due to AM Container for
appattempt_1432817967879_0003_000002 exited with exitCode: 1
>> For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then,
click on links to logs of each attempt.
>> Diagnostics: Exception from container-launch.
>> Container id: container_1432817967879_0003_02_000001
>> Exit code: 1
>> Stack trace: ExitCodeException exitCode=1:
>> at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
>> at org.apache.hadoop.util.Shell.run(Shell.java:455)
>> at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
>> at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
>> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
>> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
>> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>> at java.lang.Thread.run(Thread.java:745)
>> Container exited with a non-zero exit code 1
>> Failing this attempt. Failing the application.
>> |
>>
>> ———— Forwarded Message ————
>>
>> Subject: Re: can’t submit a job
>>
>> Date: Thu, 28 May 2015 07:48:46 -0700
>>
>> From: Ted Yu yuzhihong@gmail.com <http://mailto:yuzhihong@gmail.com>
>>
>> Reply-To: user@hadoop.apache.org
>>
>> To: common-user@hadoop.apache.org user@hadoop.apache.org 
>> <http://mailto:user@hadoop.apache.org>
>>
>> Have you checked the link 
>> http://192.168.56.101:9046/proxy/application_1432817967879_0003 
>> <http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then> ?
>> You should get come clue from logs of the 2 attempts.
>>
>> On Thu, May 28, 2015 at 6:42 AM, xeonmailinglist-gmail 
>> [xeonmailinglist@gmail.com](mailto:xeonmailinglist@gmail.com) 
>> <http://mailto:[xeonmailinglist@gmail.com]%28mailto:xeonmailinglist@gmail.com%29>

>> wrote:
>>
>>     Hi,
>>
>>     I am trying to launch a job that I have configured in in java,
>>     but I get an error related to the containers [1]. I don’t
>>     understand why I can’t submit the a job. Why get this error? What
>>     can I do to fix it?
>>
>>     Thanks,
>>
>>     [1] Log of |logs/yarn-xubuntu-nodemanager-hadoop-coc-1.log|
>>
>>     |15/05/28 09:28:21 INFO client.RMProxy: Connecting to ResourceManager at /192.168.56.101:8032
 <http://192.168.56.101:8032>
>>     15/05/28 09:28:24 INFO input.FileInputFormat: Total input paths to process :
5
>>     15/05/28 09:28:24 INFO mapreduce.JobSubmitter: number of splits:5
>>     15/05/28 09:28:24 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1432817967879_0003
>>     15/05/28 09:28:25 INFO impl.YarnClientImpl: Submitted application application_1432817967879_0003
>>     15/05/28 09:28:25 INFO mapreduce.Job: The url to track the job:http://192.168.56.101:9046/proxy/application_1432817967879_0003/
>>     15/05/28 09:28:25 INFO mapreduce.Job: Running job: job_1432817967879_0003
>>     15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 running in uber
mode : false
>>     15/05/28 09:28:29 INFO mapreduce.Job:  map 0% reduce 0%
>>     15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 failed with
state FAILED due to: Application application_1432817967879_0003 failed 2 times due to AM Cont
>>     ainer for appattempt_1432817967879_0003_000002 exited with  exitCode: 1
>>     For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then,
click on links to logs of each attempt.
>>     Diagnostics: Exception from container-launch.
>>     Container id: container_1432817967879_0003_02_000001
>>     Exit code: 1
>>     Stack trace: ExitCodeException exitCode=1:
>>              at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
>>              at org.apache.hadoop.util.Shell.run(Shell.java:455)
>>              at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
>>              at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
>>              at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
>>              at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
>>              at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>>              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>>              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>>              at java.lang.Thread.run(Thread.java:745)
>>     |
>>
>>     ​
>>
>>     -- 
>>     --
>>
>> ​
>
> -- 
> --

​

-- 
--


Mime
View raw message