hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hadoop QA (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-2170) Send out last-minute load averages in TaskTrackerStatus
Date Fri, 19 Nov 2010 09:05:16 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12933733#action_12933733
] 

Hadoop QA commented on MAPREDUCE-2170:
--------------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12459720/mapreduce.loadaverage.r3.diff
  against trunk revision 1036745.

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 6 new or modified tests.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    -1 javac.  The patch appears to cause tar ant target to fail.

    -1 findbugs.  The patch appears to introduce 1 new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit
warnings.

    -1 core tests.  The patch failed these core unit tests:
                  org.apache.hadoop.cli.TestMRCLI
                  org.apache.hadoop.conf.TestJobConf
                  org.apache.hadoop.conf.TestNoDefaultsJobConf
                  org.apache.hadoop.examples.pi.math.TestSummation
                  org.apache.hadoop.examples.terasort.TestTeraSort
                  org.apache.hadoop.examples.TestBaileyBorweinPlouffe
                  org.apache.hadoop.fs.slive.TestSlive
                  org.apache.hadoop.fs.TestDFSIO
                  org.apache.hadoop.fs.TestFileSystem
                  org.apache.hadoop.fs.TestHarFileSystem
                  org.apache.hadoop.fs.TestJHLA
                  org.apache.hadoop.io.TestSequenceFileMergeProgress
                  org.apache.hadoop.ipc.TestSocketFactory
                  org.apache.hadoop.mapred.join.TestDatamerge
                  org.apache.hadoop.mapred.lib.TestDelegatingInputFormat
                  org.apache.hadoop.mapred.pipes.TestPipesAsDifferentUser
                  org.apache.hadoop.mapred.pipes.TestPipes
                  org.apache.hadoop.mapred.TestAdminOperationsProtocolWithServiceAuthorization
                  org.apache.hadoop.mapred.TestAuditLogger
                  org.apache.hadoop.mapred.TestBadRecords
                  org.apache.hadoop.mapred.TestClusterMapReduceTestCase
                  org.apache.hadoop.mapred.TestClusterMRNotification
                  org.apache.hadoop.mapred.TestClusterStatus
                  org.apache.hadoop.mapred.TestCompositeTaskTrackerInstrumentation
                  org.apache.hadoop.mapred.TestCompressedEmptyMapOutputs
                  org.apache.hadoop.mapred.TestControlledMapReduceJob
                  org.apache.hadoop.mapred.TestDebugScriptWithLinuxTaskController
                  org.apache.hadoop.mapred.TestDebugScript
                  org.apache.hadoop.mapred.TestEmptyJob
                  org.apache.hadoop.mapred.TestFieldSelection
                  org.apache.hadoop.mapred.TestIFile
                  org.apache.hadoop.mapred.TestInputPath
                  org.apache.hadoop.mapred.TestIsolationRunner
                  org.apache.hadoop.mapred.TestJobCleanup
                  org.apache.hadoop.mapred.TestJobClient
                  org.apache.hadoop.mapred.TestJobCounters
                  org.apache.hadoop.mapred.TestJobDirCleanup
                  org.apache.hadoop.mapred.TestJobExecutionAsDifferentUser
                  org.apache.hadoop.mapred.TestJobHistory
                  org.apache.hadoop.mapred.TestJobInProgressListener
                  org.apache.hadoop.mapred.TestJobKillAndFail
                  org.apache.hadoop.mapred.TestJobName
                  org.apache.hadoop.mapred.TestJobQueueClient
                  org.apache.hadoop.mapred.TestJobQueueInformation
                  org.apache.hadoop.mapred.TestJobRetire
                  org.apache.hadoop.mapred.TestJobStatusPersistency
                  org.apache.hadoop.mapred.TestJobSysDirWithDFS
                  org.apache.hadoop.mapred.TestJobTrackerInstrumentation
                  org.apache.hadoop.mapred.TestJobTrackerStart
                  org.apache.hadoop.mapred.TestJobTrackerXmlJsp
                  org.apache.hadoop.mapred.TestJvmManager
                  org.apache.hadoop.mapred.TestJvmReuse
                  org.apache.hadoop.mapred.TestKeyValueTextInputFormat
                  org.apache.hadoop.mapred.TestKillSubProcessesWithLinuxTaskController
                  org.apache.hadoop.mapred.TestKillSubProcesses
                  org.apache.hadoop.mapred.TestLazyOutput
                  org.apache.hadoop.mapred.TestLimitTasksPerJobTaskScheduler
                  org.apache.hadoop.mapred.TestLinuxTaskController
                  org.apache.hadoop.mapred.TestLocalizationWithLinuxTaskController
                  org.apache.hadoop.mapred.TestMapProgress
                  org.apache.hadoop.mapred.TestMapredHeartbeat
                  org.apache.hadoop.mapred.TestMapredSystemDir
                  org.apache.hadoop.mapred.TestMiniMRClasspath
                  org.apache.hadoop.mapred.TestMiniMRLocalFS
                  org.apache.hadoop.mapred.TestMiniMRWithDFS
                  org.apache.hadoop.mapred.TestMRServerPorts
                  org.apache.hadoop.mapred.TestMRWithDistributedCache
                  org.apache.hadoop.mapred.TestMultiFileInputFormat
                  org.apache.hadoop.mapred.TestMultiFileSplit
                  org.apache.hadoop.mapred.TestMultipleLevelCaching
                  org.apache.hadoop.mapred.TestMultipleTextOutputFormat
                  org.apache.hadoop.mapred.TestNodeHealthService
                  org.apache.hadoop.mapred.TestNodeRefresh
                  org.apache.hadoop.mapred.TestParallelInitialization
                  org.apache.hadoop.mapred.TestQueueManagerWithJobTracker
                  org.apache.hadoop.mapred.TestQueueManager
                  org.apache.hadoop.mapred.TestRecoveryManager
                  org.apache.hadoop.mapred.TestSetupAndCleanupFailure
                  org.apache.hadoop.mapred.TestSpecialCharactersInOutputPath
                  org.apache.hadoop.mapred.TestSubmitJob
                  org.apache.hadoop.mapred.TestTaskFail
                  org.apache.hadoop.mapred.TestTaskOutputSize
                  org.apache.hadoop.mapred.TestTaskTrackerMemoryManager
                  org.apache.hadoop.mapred.TestTaskTrackerSlotManagement
                  org.apache.hadoop.mapred.TestTrackerReservation
                  org.apache.hadoop.mapred.TestTTResourceReporting
                  org.apache.hadoop.mapred.TestWebUIAuthorization
                  org.apache.hadoop.mapreduce.lib.input.TestCombineFileInputFormat
                  org.apache.hadoop.mapreduce.lib.input.TestDelegatingInputFormat
                  org.apache.hadoop.mapreduce.lib.join.TestJoinDatamerge
                  org.apache.hadoop.mapreduce.lib.join.TestJoinProperties
                  org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter
                  org.apache.hadoop.mapreduce.security.TestBinaryTokenFile
                  org.apache.hadoop.mapreduce.security.TestTokenCacheOldApi
                  org.apache.hadoop.mapreduce.security.TestTokenCache
                  org.apache.hadoop.mapreduce.security.TestUmbilicalProtocolWithJobToken
                  org.apache.hadoop.mapreduce.security.token.TestDelegationTokenRenewal
                  org.apache.hadoop.mapreduce.TestChild
                  org.apache.hadoop.mapreduce.TestJobACLs
                  org.apache.hadoop.mapreduce.TestMapReduceLazyOutput
                  org.apache.hadoop.mapreduce.TestMapReduceLocal
                  org.apache.hadoop.mapreduce.TestMRJobClient
                  org.apache.hadoop.mapreduce.TestNoJobSetupCleanup
                  org.apache.hadoop.mapreduce.TestTaskContext
                  org.apache.hadoop.security.authorize.TestServiceLevelAuthorization
                  org.apache.hadoop.security.TestMapredGroupMappingServiceRefresh
                  org.apache.hadoop.tools.rumen.TestRumenJobTraces
                  org.apache.hadoop.tools.TestCopyFiles
                  org.apache.hadoop.tools.TestDistCh
                  org.apache.hadoop.tools.TestHadoopArchives
                  org.apache.hadoop.tools.TestHarFileSystem

    -1 contrib tests.  The patch failed contrib unit tests.

    +1 system test framework.  The patch passed system test framework compile.

Test results: https://hudson.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/6//testReport/
Findbugs warnings: https://hudson.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/6//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: https://hudson.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/6//console

This message is automatically generated.

> Send out last-minute load averages in TaskTrackerStatus
> -------------------------------------------------------
>
>                 Key: MAPREDUCE-2170
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2170
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: jobtracker
>    Affects Versions: 0.22.0
>         Environment: GNU/Linux
>            Reporter: Harsh J Chouraria
>            Assignee: Harsh J Chouraria
>            Priority: Minor
>             Fix For: 0.22.0
>
>         Attachments: mapreduce.loadaverage.r3.diff
>
>   Original Estimate: 0.33h
>  Remaining Estimate: 0.33h
>
> Load averages could be useful in scheduling. This patch looks to extend the existing
Linux resource plugin (via /proc/loadavg file) to allow transmitting load averages of the
last one minute via the TaskTrackerStatus.
> Patch is up for review, with test cases added, at: https://reviews.apache.org/r/20/

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message