hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hadoop QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-5577) Allow querying the JobHistoryServer by job arrival time
Date Tue, 12 May 2015 23:41:02 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-5577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14541015#comment-14541015
] 

Hadoop QA commented on MAPREDUCE-5577:
--------------------------------------

\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | pre-patch |  15m  7s | Pre-patch trunk compilation is healthy. |
| {color:green}+1{color} | @author |   0m  0s | The patch does not contain any @author tags.
|
| {color:green}+1{color} | tests included |   0m  0s | The patch appears to include 4 new
or modified test files. |
| {color:green}+1{color} | javac |   7m 35s | There were no new javac warning messages. |
| {color:green}+1{color} | javadoc |   9m 39s | There were no new javadoc warning messages.
|
| {color:green}+1{color} | release audit |   0m 23s | The applied patch does not increase
the total number of release audit warnings. |
| {color:red}-1{color} | checkstyle |   0m 27s | The applied patch generated  19 new checkstyle
issues (total was 57, now 62). |
| {color:red}-1{color} | whitespace |   0m  5s | The patch has 27  line(s) that end in whitespace.
Use git apply --whitespace=fix. |
| {color:green}+1{color} | install |   1m 33s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse |   0m 32s | The patch built with eclipse:eclipse.
|
| {color:red}-1{color} | findbugs |   0m 49s | The patch appears to introduce 3 new Findbugs
(version 2.0.3) warnings. |
| {color:red}-1{color} | mapreduce tests |   5m 44s | Tests failed in hadoop-mapreduce-client-hs.
|
| | |  41m 59s | |
\\
\\
|| Reason || Tests ||
| FindBugs | module:hadoop-mapreduce-client-hs |
|  |  Dead store to aBegin in org.apache.hadoop.mapreduce.v2.hs.CachedHistoryStorage.getPartialJobs(Iterable,
Long, Long, String, String, Long, Long, Long, Long, Long, Long, JobState)  At CachedHistoryStorage.java:org.apache.hadoop.mapreduce.v2.hs.CachedHistoryStorage.getPartialJobs(Iterable,
Long, Long, String, String, Long, Long, Long, Long, Long, Long, JobState)  At CachedHistoryStorage.java:[line
232] |
|  |  Dead store to aEnd in org.apache.hadoop.mapreduce.v2.hs.CachedHistoryStorage.getPartialJobs(Iterable,
Long, Long, String, String, Long, Long, Long, Long, Long, Long, JobState)  At CachedHistoryStorage.java:org.apache.hadoop.mapreduce.v2.hs.CachedHistoryStorage.getPartialJobs(Iterable,
Long, Long, String, String, Long, Long, Long, Long, Long, Long, JobState)  At CachedHistoryStorage.java:[line
234] |
|  |  Should org.apache.hadoop.mapreduce.v2.hs.CachedHistoryStorage$JobIndexInfoIterable be
a _static_ inner class?  At CachedHistoryStorage.java:inner class?  At CachedHistoryStorage.java:[lines
189-198] |
| Failed unit tests | hadoop.mapreduce.v2.hs.webapp.TestHsWebServicesJobsQuery |
|   | hadoop.mapreduce.v2.hs.webapp.TestHsWebServicesJobs |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL | http://issues.apache.org/jira/secure/attachment/12608423/MAPREDUCE-5577.patch
|
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / f24452d |
| checkstyle |  https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5717/artifact/patchprocess/diffcheckstylehadoop-mapreduce-client-hs.txt
|
| whitespace | https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5717/artifact/patchprocess/whitespace.txt
|
| Findbugs warnings | https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5717/artifact/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-hs.html
|
| hadoop-mapreduce-client-hs test log | https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5717/artifact/patchprocess/testrun_hadoop-mapreduce-client-hs.txt
|
| Test Results | https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5717/testReport/
|
| Java | 1.7.0_55 |
| uname | Linux asf903.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep
3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output | https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5717/console |


This message was automatically generated.

> Allow querying the JobHistoryServer by job arrival time
> -------------------------------------------------------
>
>                 Key: MAPREDUCE-5577
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5577
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: jobhistoryserver
>            Reporter: Sandy Ryza
>            Assignee: Sandy Ryza
>         Attachments: MAPREDUCE-5577.patch
>
>
>   The JobHistoryServer REST APIs currently allow querying by job submit time and finish
time.  However, jobs don't necessarily arrive in order of their finish time, meaning that
a client who wants to stay on top of all completed jobs needs to query large time intervals
to make sure they're not missing anything.  Exposing functionality to allow querying by the
time a job lands at the JobHistoryServer would allow clients to set the start of their query
interval to the time of their last query. 
> The arrival time of a job would be defined as the time that it lands in the done directory
and can be picked up using the last modified date on history files.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message