hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hadoop QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-1283) Invalid 'url of job' mentioned in Job output with yarn.http.policy=HTTPS_ONLY
Date Mon, 07 Oct 2013 22:03:42 GMT

    [ https://issues.apache.org/jira/browse/YARN-1283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13788633#comment-13788633
] 

Hadoop QA commented on YARN-1283:
---------------------------------

{color:red}-1 overall{color}.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12607236/YARN-1283.20131007.1.patch
  against trunk revision .

    {color:green}+1 @author{color}.  The patch does not contain any @author tags.

    {color:red}-1 tests included{color}.  The patch doesn't appear to include any new or modified
tests.
                        Please justify why no new tests are needed for this patch.
                        Also please list what manual steps were performed to verify this patch.

    {color:green}+1 javac{color}.  The applied patch does not increase the total number of
javac compiler warnings.

    {color:red}-1 javadoc{color}.  The javadoc tool appears to have generated 1 warning messages.

    {color:green}+1 eclipse:eclipse{color}.  The patch built with eclipse:eclipse.

    {color:green}+1 findbugs{color}.  The patch does not introduce any new Findbugs (version
1.3.9) warnings.

    {color:green}+1 release audit{color}.  The applied patch does not increase the total number
of release audit warnings.

    {color:red}-1 core tests{color}.  The patch failed these unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager:

                  org.apache.hadoop.mapred.TestNetworkedJob
                  org.apache.hadoop.mapred.TestClusterMRNotification
                  org.apache.hadoop.mapred.TestMiniMRClasspath
                  org.apache.hadoop.mapred.TestBlockLimits
                  org.apache.hadoop.mapred.TestMiniMRWithDFSWithDistinctUsers
                  org.apache.hadoop.mapred.TestMiniMRChildTask
                  org.apache.hadoop.mapred.TestReduceFetch
                  org.apache.hadoop.mapred.TestReduceFetchFromPartialMem
                  org.apache.hadoop.mapred.TestMerge
                  org.apache.hadoop.mapred.TestJobName
                  org.apache.hadoop.mapred.TestLazyOutput
                  org.apache.hadoop.mapred.TestJobSysDirWithDFS

                                      The following test timeouts occurred in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager:

org.apache.hadoop.mapred.TestJobCleanup
org.apache.hadoop.mapred.TestJobCounters
org.apache.hadoop.mapred.TestClusterMapReduceTestCase

                                      The test build failed in hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common 

    {color:green}+1 contrib tests{color}.  The patch passed contrib unit tests.

Test results: https://builds.apache.org/job/PreCommit-YARN-Build/2139//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/2139//console

This message is automatically generated.

> Invalid 'url of job' mentioned in Job output with yarn.http.policy=HTTPS_ONLY
> -----------------------------------------------------------------------------
>
>                 Key: YARN-1283
>                 URL: https://issues.apache.org/jira/browse/YARN-1283
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>    Affects Versions: 2.1.1-beta
>            Reporter: Yesha Vora
>            Assignee: Omkar Vinit Joshi
>              Labels: newbie
>         Attachments: YARN-1283.20131007.1.patch
>
>
> After setting yarn.http.policy=HTTPS_ONLY, the job output shows incorrect "The url to
track the job".
> Currently, its printing http://RM:<httpsport>/proxy/application_1381162886563_0001/
instead https://RM:<httpsport>/proxy/application_1381162886563_0001/
> http://hostname:8088/proxy/application_1381162886563_0001/ is invalid
> hadoop  jar hadoop-mapreduce-client-jobclient-tests.jar sleep -m 1 -r 1 
> 13/10/07 18:39:39 INFO client.RMProxy: Connecting to ResourceManager at hostname/100.00.00.000:8032
> 13/10/07 18:39:40 INFO mapreduce.JobSubmitter: number of splits:1
> 13/10/07 18:39:40 INFO Configuration.deprecation: user.name is deprecated. Instead, use
mapreduce.job.user.name
> 13/10/07 18:39:40 INFO Configuration.deprecation: mapred.jar is deprecated. Instead,
use mapreduce.job.jar
> 13/10/07 18:39:40 INFO Configuration.deprecation: mapred.map.tasks.speculative.execution
is deprecated. Instead, use mapreduce.map.speculative
> 13/10/07 18:39:40 INFO Configuration.deprecation: mapred.reduce.tasks is deprecated.
Instead, use mapreduce.job.reduces
> 13/10/07 18:39:40 INFO Configuration.deprecation: mapreduce.partitioner.class is deprecated.
Instead, use mapreduce.job.partitioner.class
> 13/10/07 18:39:40 INFO Configuration.deprecation: mapred.reduce.tasks.speculative.execution
is deprecated. Instead, use mapreduce.reduce.speculative
> 13/10/07 18:39:40 INFO Configuration.deprecation: mapred.mapoutput.value.class is deprecated.
Instead, use mapreduce.map.output.value.class
> 13/10/07 18:39:40 INFO Configuration.deprecation: mapreduce.map.class is deprecated.
Instead, use mapreduce.job.map.class
> 13/10/07 18:39:40 INFO Configuration.deprecation: mapred.job.name is deprecated. Instead,
use mapreduce.job.name
> 13/10/07 18:39:40 INFO Configuration.deprecation: mapreduce.reduce.class is deprecated.
Instead, use mapreduce.job.reduce.class
> 13/10/07 18:39:40 INFO Configuration.deprecation: mapreduce.inputformat.class is deprecated.
Instead, use mapreduce.job.inputformat.class
> 13/10/07 18:39:40 INFO Configuration.deprecation: mapred.input.dir is deprecated. Instead,
use mapreduce.input.fileinputformat.inputdir
> 13/10/07 18:39:40 INFO Configuration.deprecation: mapreduce.outputformat.class is deprecated.
Instead, use mapreduce.job.outputformat.class
> 13/10/07 18:39:40 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead,
use mapreduce.job.maps
> 13/10/07 18:39:40 INFO Configuration.deprecation: mapred.mapoutput.key.class is deprecated.
Instead, use mapreduce.map.output.key.class
> 13/10/07 18:39:40 INFO Configuration.deprecation: mapred.working.dir is deprecated. Instead,
use mapreduce.job.working.dir
> 13/10/07 18:39:40 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1381162886563_0001
> 13/10/07 18:39:40 INFO impl.YarnClientImpl: Submitted application application_1381162886563_0001
to ResourceManager at hostname/100.00.00.000:8032
> 13/10/07 18:39:40 INFO mapreduce.Job: The url to track the job: http://hostname:8088/proxy/application_1381162886563_0001/
> 13/10/07 18:39:40 INFO mapreduce.Job: Running job: job_1381162886563_0001
> 13/10/07 18:39:46 INFO mapreduce.Job: Job job_1381162886563_0001 running in uber mode
: false
> 13/10/07 18:39:46 INFO mapreduce.Job:  map 0% reduce 0%
> 13/10/07 18:39:53 INFO mapreduce.Job:  map 100% reduce 0%
> 13/10/07 18:39:58 INFO mapreduce.Job:  map 100% reduce 100%
> 13/10/07 18:39:58 INFO mapreduce.Job: Job job_1381162886563_0001 completed successfully
> 13/10/07 18:39:58 INFO mapreduce.Job: Counters: 43
> 	File System Counters
> 		FILE: Number of bytes read=26
> 		FILE: Number of bytes written=177279
> 		FILE: Number of read operations=0
> 		FILE: Number of large read operations=0
> 		FILE: Number of write operations=0
> 		HDFS: Number of bytes read=48
> 		HDFS: Number of bytes written=0
> 		HDFS: Number of read operations=1
> 		HDFS: Number of large read operations=0
> 		HDFS: Number of write operations=0
> 	Job Counters 
> 		Launched map tasks=1
> 		Launched reduce tasks=1
> 		Other local map tasks=1
> 		Total time spent by all maps in occupied slots (ms)=7136
> 		Total time spent by all reduces in occupied slots (ms)=6062
> 	Map-Reduce Framework
> 		Map input records=1
> 		Map output records=1
> 		Map output bytes=4
> 		Map output materialized bytes=22
> 		Input split bytes=48
> 		Combine input records=0
> 		Combine output records=0
> 		Reduce input groups=1
> 		Reduce shuffle bytes=22
> 		Reduce input records=1
> 		Reduce output records=0
> 		Spilled Records=2
> 		Shuffled Maps =1
> 		Failed Shuffles=0
> 		Merged Map outputs=1
> 		GC time elapsed (ms)=60
> 		CPU time spent (ms)=1700
> 		Physical memory (bytes) snapshot=567582720
> 		Virtual memory (bytes) snapshot=4292997120
> 		Total committed heap usage (bytes)=846594048
> 	Shuffle Errors
> 		BAD_ID=0
> 		CONNECTION=0
> 		IO_ERROR=0
> 		WRONG_LENGTH=0
> 		WRONG_MAP=0
> 		WRONG_REDUCE=0
> 	File Input Format Counters 
> 		Bytes Read=0
> 	File Output Format Counters 
> 		Bytes Written=0



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message