hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From xeonmailinglist-gmail <xeonmailingl...@gmail.com>
Subject Re: Fwd: Re: can't submit a job
Date Fri, 29 May 2015 08:35:29 GMT
For this error, do I need to set |yarn.application.classpath|? If so, 
what should I put?

Any help for this question, please?

thanks,

On 05/28/2015 06:39 PM, xeonmailinglist-gmail wrote:

> Hi,
>
> But I still have a problem, and it is because I can’t launch a job. 
> After I launch |wordcount| example, I get the error [1]. After 
> inspecting the error, I have found this error in the job history [2], 
> and maybe this is the reason. So, I have looked to my |.bashrc| [3], 
> but it seems that everything is well configured. Thus, the question 
> remains. Why I can’t launch this job? Am I configuring something wrong?
>
> [1]
>
> |15/05/28 13:33:43 INFO mapreduce.Job: Job job_1432834333314_0002 failed with state FAILED
due to: Application application_1432834333314_0002 failed 2 times due to AM Container for
appattempt_1432834333314_0002_000002 exited with  exitCode: 1
> For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432834333314_0002/Then,
click on links to logs of each attempt.
> Diagnostics: Exception from container-launch.
> Container id: container_1432834333314_0002_02_000001
> Exit code: 1
> Stack trace: ExitCodeException exitCode=1:
>          at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
>          at org.apache.hadoop.util.Shell.run(Shell.java:455)
>          at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
>          at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
>          at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
>          at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
>          at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>          at java.lang.Thread.run(Thread.java:745)
> |
>
> [2]
>
> |
> Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster
> |
>
> [3] .bashrc
>
> |export JAVA_HOME=/usr/lib/jvm/java-8-oracle
> export HADOOP_HOME=$HOME/Programs/hadoop
> export HADOOP_INSTALL=$HOME/Programs/hadoop
> export HADOOP_COMMON_HOME=$HADOOP_HOME
> export HADOOP_HDFS_HOME=$HADOOP_HOME
> export YARN_HOME=$HADOOP_HOME
> export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_HOME/lib/native
>
> export PATH=$JAVA_HOME/bin:${HADOOP_INSTALL}/bin:${HADOOP_INSTALL}/sbin:$PATH
> |
>
> On 05/28/2015 04:13 PM, xeonmailinglist-gmail wrote:
>
>> I have found why I couldn’t access the container. I needed to have in 
>> |yarn-site.xml| the property:
>>
>> |<property> <name>yarn.log.server.url</name> <value>http://192.168.56.101:19888/jobhistory/logs/</value>
</property>
>> |
>>
>> On 05/28/2015 04:01 PM, xeonmailinglist-gmail wrote:
>>
>>> If I click in the logs link, I get the error. So it seems that my 
>>> job isn't launching and the container aren't working. I need to fix 
>>> both errors. Any suggestion?
>>>
>>> ```
>>>
>>>
>>>   Failed redirect for container_1432817967879_0003_01_000001
>>>
>>>
>>>       ResourceManager
>>>
>>>   * RM Home <http://hadoop-coc-1:8088/>
>>>
>>>
>>>       NodeManager
>>>
>>>
>>>       Tools
>>>
>>> 	
>>>
>>>
>>>   Failed while trying to construct the redirect url to the log
>>>   server. Log Server url may not be configured
>>>
>>>
>>>   java.lang.Exception: Unknown container. Container either has not
>>>   started or has already completed or doesn't belong to this node at
>>>   all.
>>>
>>>
>>>
>>> ```
>>>
>>> On 05/28/2015 03:59 PM, xeonmailinglist-gmail wrote:
>>>>
>>>> The error that I got is [1], but I still don’t understand why I get 
>>>> this error. I couldn’t find more detail about it. Any suggestion?
>>>>
>>>> [1]
>>>>
>>>> |
>>>> Application application_1432817967879_0003 failed 2 times due to AM Container
for appattempt_1432817967879_0003_000002 exited with exitCode: 1
>>>> For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then,
click on links to logs of each attempt.
>>>> Diagnostics: Exception from container-launch.
>>>> Container id: container_1432817967879_0003_02_000001
>>>> Exit code: 1
>>>> Stack trace: ExitCodeException exitCode=1:
>>>> at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
>>>> at org.apache.hadoop.util.Shell.run(Shell.java:455)
>>>> at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
>>>> at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
>>>> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
>>>> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
>>>> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>>>> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>>>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>>>> at java.lang.Thread.run(Thread.java:745)
>>>> Container exited with a non-zero exit code 1
>>>> Failing this attempt. Failing the application.
>>>> |
>>>>
>>>> ———— Forwarded Message ————
>>>>
>>>> Subject: Re: can’t submit a job
>>>>
>>>> Date: Thu, 28 May 2015 07:48:46 -0700
>>>>
>>>> From: Ted Yu yuzhihong@gmail.com <http://mailto:yuzhihong@gmail.com>
>>>>
>>>> Reply-To: user@hadoop.apache.org
>>>>
>>>> To: common-user@hadoop.apache.org user@hadoop.apache.org 
>>>> <http://mailto:user@hadoop.apache.org>
>>>>
>>>> Have you checked the link 
>>>> http://192.168.56.101:9046/proxy/application_1432817967879_0003 
>>>> <http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then>

>>>> ?
>>>> You should get come clue from logs of the 2 attempts.
>>>>
>>>> On Thu, May 28, 2015 at 6:42 AM, xeonmailinglist-gmail 
>>>> [xeonmailinglist@gmail.com](mailto:xeonmailinglist@gmail.com) 
>>>> <http://mailto:[xeonmailinglist@gmail.com]%28mailto:xeonmailinglist@gmail.com%29>

>>>> wrote:
>>>>
>>>>     Hi,
>>>>
>>>>     I am trying to launch a job that I have configured in in java,
>>>>     but I get an error related to the containers [1]. I don’t
>>>>     understand why I can’t submit the a job. Why get this error?
>>>>     What can I do to fix it?
>>>>
>>>>     Thanks,
>>>>
>>>>     [1] Log of |logs/yarn-xubuntu-nodemanager-hadoop-coc-1.log|
>>>>
>>>>     |15/05/28 09:28:21 INFO client.RMProxy: Connecting to ResourceManager
at /192.168.56.101:8032  <http://192.168.56.101:8032>
>>>>     15/05/28 09:28:24 INFO input.FileInputFormat: Total input paths to process
: 5
>>>>     15/05/28 09:28:24 INFO mapreduce.JobSubmitter: number of splits:5
>>>>     15/05/28 09:28:24 INFO mapreduce.JobSubmitter: Submitting tokens for
job: job_1432817967879_0003
>>>>     15/05/28 09:28:25 INFO impl.YarnClientImpl: Submitted application application_1432817967879_0003
>>>>     15/05/28 09:28:25 INFO mapreduce.Job: The url to track the job:http://192.168.56.101:9046/proxy/application_1432817967879_0003/
>>>>     15/05/28 09:28:25 INFO mapreduce.Job: Running job: job_1432817967879_0003
>>>>     15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 running
in uber mode : false
>>>>     15/05/28 09:28:29 INFO mapreduce.Job:  map 0% reduce 0%
>>>>     15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 failed
with state FAILED due to: Application application_1432817967879_0003 failed 2 times due to
AM Cont
>>>>     ainer for appattempt_1432817967879_0003_000002 exited with  exitCode:
1
>>>>     For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then,
click on links to logs of each attempt.
>>>>     Diagnostics: Exception from container-launch.
>>>>     Container id: container_1432817967879_0003_02_000001
>>>>     Exit code: 1
>>>>     Stack trace: ExitCodeException exitCode=1:
>>>>              at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
>>>>              at org.apache.hadoop.util.Shell.run(Shell.java:455)
>>>>              at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
>>>>              at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
>>>>              at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
>>>>              at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
>>>>              at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>>>>              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>>>>              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>>>>              at java.lang.Thread.run(Thread.java:745)
>>>>     |
>>>>
>>>>     ​
>>>>
>>>>     -- 
>>>>     --
>>>>
>>>> ​
>>>
>>> -- 
>>> --
>> ​
>> -- 
>> --
> ​
> -- 
> --

​

-- 
--


Mime
View raw message