hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hadoop QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-1283) Invalid 'url of job' mentioned in Job output with yarn.http.policy=HTTPS_ONLY
Date Wed, 09 Oct 2013 04:12:43 GMT

    [ https://issues.apache.org/jira/browse/YARN-1283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13790011#comment-13790011
] 

Hadoop QA commented on YARN-1283:
---------------------------------

{color:red}-1 overall{color}.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12607494/YARN-1283.20131008.2.patch
  against trunk revision .

    {color:green}+1 @author{color}.  The patch does not contain any @author tags.

    {color:green}+1 tests included{color}.  The patch appears to include 1 new or modified
test files.

    {color:green}+1 javac{color}.  The applied patch does not increase the total number of
javac compiler warnings.

    {color:green}+1 javadoc{color}.  The javadoc tool did not generate any warning messages.

    {color:green}+1 eclipse:eclipse{color}.  The patch built with eclipse:eclipse.

    {color:green}+1 findbugs{color}.  The patch does not introduce any new Findbugs (version
1.3.9) warnings.

    {color:green}+1 release audit{color}.  The applied patch does not increase the total number
of release audit warnings.

    {color:red}-1 core tests{color}.  The patch failed these unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager:

                  org.apache.hadoop.mapred.TestJobCleanup
                  org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.TestRMAppAttemptTransitions

                                      The following test timeouts occurred in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager:

org.apache.hadoop.mapreduce.v2.TestUberAM

    {color:green}+1 contrib tests{color}.  The patch passed contrib unit tests.

Test results: https://builds.apache.org/job/PreCommit-YARN-Build/2148//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/2148//console

This message is automatically generated.

> Invalid 'url of job' mentioned in Job output with yarn.http.policy=HTTPS_ONLY
> -----------------------------------------------------------------------------
>
>                 Key: YARN-1283
>                 URL: https://issues.apache.org/jira/browse/YARN-1283
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>    Affects Versions: 2.1.1-beta
>            Reporter: Yesha Vora
>            Assignee: Omkar Vinit Joshi
>              Labels: newbie
>         Attachments: YARN-1283.20131007.1.patch, YARN-1283.20131008.1.patch, YARN-1283.20131008.2.patch
>
>
> After setting yarn.http.policy=HTTPS_ONLY, the job output shows incorrect "The url to
track the job".
> Currently, its printing http://RM:<httpsport>/proxy/application_1381162886563_0001/
instead https://RM:<httpsport>/proxy/application_1381162886563_0001/
> http://hostname:8088/proxy/application_1381162886563_0001/ is invalid
> hadoop  jar hadoop-mapreduce-client-jobclient-tests.jar sleep -m 1 -r 1 
> 13/10/07 18:39:39 INFO client.RMProxy: Connecting to ResourceManager at hostname/100.00.00.000:8032
> 13/10/07 18:39:40 INFO mapreduce.JobSubmitter: number of splits:1
> 13/10/07 18:39:40 INFO Configuration.deprecation: user.name is deprecated. Instead, use
mapreduce.job.user.name
> 13/10/07 18:39:40 INFO Configuration.deprecation: mapred.jar is deprecated. Instead,
use mapreduce.job.jar
> 13/10/07 18:39:40 INFO Configuration.deprecation: mapred.map.tasks.speculative.execution
is deprecated. Instead, use mapreduce.map.speculative
> 13/10/07 18:39:40 INFO Configuration.deprecation: mapred.reduce.tasks is deprecated.
Instead, use mapreduce.job.reduces
> 13/10/07 18:39:40 INFO Configuration.deprecation: mapreduce.partitioner.class is deprecated.
Instead, use mapreduce.job.partitioner.class
> 13/10/07 18:39:40 INFO Configuration.deprecation: mapred.reduce.tasks.speculative.execution
is deprecated. Instead, use mapreduce.reduce.speculative
> 13/10/07 18:39:40 INFO Configuration.deprecation: mapred.mapoutput.value.class is deprecated.
Instead, use mapreduce.map.output.value.class
> 13/10/07 18:39:40 INFO Configuration.deprecation: mapreduce.map.class is deprecated.
Instead, use mapreduce.job.map.class
> 13/10/07 18:39:40 INFO Configuration.deprecation: mapred.job.name is deprecated. Instead,
use mapreduce.job.name
> 13/10/07 18:39:40 INFO Configuration.deprecation: mapreduce.reduce.class is deprecated.
Instead, use mapreduce.job.reduce.class
> 13/10/07 18:39:40 INFO Configuration.deprecation: mapreduce.inputformat.class is deprecated.
Instead, use mapreduce.job.inputformat.class
> 13/10/07 18:39:40 INFO Configuration.deprecation: mapred.input.dir is deprecated. Instead,
use mapreduce.input.fileinputformat.inputdir
> 13/10/07 18:39:40 INFO Configuration.deprecation: mapreduce.outputformat.class is deprecated.
Instead, use mapreduce.job.outputformat.class
> 13/10/07 18:39:40 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead,
use mapreduce.job.maps
> 13/10/07 18:39:40 INFO Configuration.deprecation: mapred.mapoutput.key.class is deprecated.
Instead, use mapreduce.map.output.key.class
> 13/10/07 18:39:40 INFO Configuration.deprecation: mapred.working.dir is deprecated. Instead,
use mapreduce.job.working.dir
> 13/10/07 18:39:40 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1381162886563_0001
> 13/10/07 18:39:40 INFO impl.YarnClientImpl: Submitted application application_1381162886563_0001
to ResourceManager at hostname/100.00.00.000:8032
> 13/10/07 18:39:40 INFO mapreduce.Job: The url to track the job: http://hostname:8088/proxy/application_1381162886563_0001/
> 13/10/07 18:39:40 INFO mapreduce.Job: Running job: job_1381162886563_0001
> 13/10/07 18:39:46 INFO mapreduce.Job: Job job_1381162886563_0001 running in uber mode
: false
> 13/10/07 18:39:46 INFO mapreduce.Job:  map 0% reduce 0%
> 13/10/07 18:39:53 INFO mapreduce.Job:  map 100% reduce 0%
> 13/10/07 18:39:58 INFO mapreduce.Job:  map 100% reduce 100%
> 13/10/07 18:39:58 INFO mapreduce.Job: Job job_1381162886563_0001 completed successfully
> 13/10/07 18:39:58 INFO mapreduce.Job: Counters: 43
> 	File System Counters
> 		FILE: Number of bytes read=26
> 		FILE: Number of bytes written=177279
> 		FILE: Number of read operations=0
> 		FILE: Number of large read operations=0
> 		FILE: Number of write operations=0
> 		HDFS: Number of bytes read=48
> 		HDFS: Number of bytes written=0
> 		HDFS: Number of read operations=1
> 		HDFS: Number of large read operations=0
> 		HDFS: Number of write operations=0
> 	Job Counters 
> 		Launched map tasks=1
> 		Launched reduce tasks=1
> 		Other local map tasks=1
> 		Total time spent by all maps in occupied slots (ms)=7136
> 		Total time spent by all reduces in occupied slots (ms)=6062
> 	Map-Reduce Framework
> 		Map input records=1
> 		Map output records=1
> 		Map output bytes=4
> 		Map output materialized bytes=22
> 		Input split bytes=48
> 		Combine input records=0
> 		Combine output records=0
> 		Reduce input groups=1
> 		Reduce shuffle bytes=22
> 		Reduce input records=1
> 		Reduce output records=0
> 		Spilled Records=2
> 		Shuffled Maps =1
> 		Failed Shuffles=0
> 		Merged Map outputs=1
> 		GC time elapsed (ms)=60
> 		CPU time spent (ms)=1700
> 		Physical memory (bytes) snapshot=567582720
> 		Virtual memory (bytes) snapshot=4292997120
> 		Total committed heap usage (bytes)=846594048
> 	Shuffle Errors
> 		BAD_ID=0
> 		CONNECTION=0
> 		IO_ERROR=0
> 		WRONG_LENGTH=0
> 		WRONG_MAP=0
> 		WRONG_REDUCE=0
> 	File Input Format Counters 
> 		Bytes Read=0
> 	File Output Format Counters 
> 		Bytes Written=0



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message