hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hadoop QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-4840) Delete dead code and deprecate public API related to skipping bad records
Date Sat, 02 May 2015 12:06:06 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-4840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14525227#comment-14525227
] 

Hadoop QA commented on MAPREDUCE-4840:
--------------------------------------

\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | pre-patch |  14m 31s | Pre-patch trunk compilation is healthy. |
| {color:green}+1{color} | @author |   0m  0s | The patch does not contain any @author tags.
|
| {color:green}+1{color} | tests included |   0m  0s | The patch appears to include 1 new
or modified test files. |
| {color:red}-1{color} | javac |   7m 29s | The applied patch generated  164  additional warning
messages. |
| {color:green}+1{color} | javadoc |   9m 34s | There were no new javadoc warning messages.
|
| {color:green}+1{color} | release audit |   0m 23s | The applied patch does not increase
the total number of release audit warnings. |
| {color:red}-1{color} | checkstyle |   1m  7s | The applied patch generated  8 new checkstyle
issues (total was 613, now 531). |
| {color:red}-1{color} | whitespace |   0m  0s | The patch has 1  line(s) that end in whitespace.
Use git apply --whitespace=fix. |
| {color:green}+1{color} | install |   1m 33s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse |   0m 32s | The patch built with eclipse:eclipse.
|
| {color:red}-1{color} | findbugs |   1m 59s | The patch appears to introduce 1 new Findbugs
(version 2.0.3) warnings. |
| {color:green}+1{color} | mapreduce tests |   1m 36s | Tests passed in hadoop-mapreduce-client-core.
|
| {color:green}+1{color} | mapreduce tests | 104m  6s | Tests passed in hadoop-mapreduce-client-jobclient.
|
| | | 143m 12s | |
\\
\\
|| Reason || Tests ||
| FindBugs | module:hadoop-mapreduce-client-core |
|  |  Should org.apache.hadoop.mapred.MapTask$TrackedRecordReader be a _static_ inner class?
 At MapTask.java:inner class?  At MapTask.java:[lines 151-228] |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL | http://issues.apache.org/jira/secure/attachment/12555682/MAPREDUCE-4840.patch
|
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / f1a152c |
| javac | https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5586/artifact/patchprocess/diffJavacWarnings.txt
|
| checkstyle |  https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5586/artifact/patchprocess/diffcheckstylehadoop-mapreduce-client-core.txt
|
| whitespace | https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5586/artifact/patchprocess/whitespace.txt
|
| Findbugs warnings | https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5586/artifact/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-core.html
|
| hadoop-mapreduce-client-core test log | https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5586/artifact/patchprocess/testrun_hadoop-mapreduce-client-core.txt
|
| hadoop-mapreduce-client-jobclient test log | https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5586/artifact/patchprocess/testrun_hadoop-mapreduce-client-jobclient.txt
|
| Test Results | https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5586/testReport/
|
| Java | 1.7.0_55 |
| uname | Linux asf902.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep
3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output | https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5586/console |


This message was automatically generated.

> Delete dead code and deprecate public API related to skipping bad records
> -------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-4840
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4840
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>    Affects Versions: 2.0.0-alpha
>            Reporter: Mostafa Elhemali
>            Priority: Minor
>         Attachments: MAPREDUCE-4840.patch
>
>
> It looks like the decision was made in MAPREDUCE-1932 to remove support for skipping
bad records rather than fix it (it doesn't work right now in trunk). If that's the case then
we should probably delete all the dead code related to it and deprecate the public API's for
it right?
> Dead code I'm talking about:
> 1. Task class: skipping, skipRanges, writeSkipRecs
> 2. MapTask class:  SkippingRecordReader inner class
> 3. ReduceTask class: SkippingReduceValuesIterator inner class
> 4. Tests: TestBadRecords
> Public API:
> 1. SkipBadRecords class



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message