hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Harsh Chouraria" <qwertyman...@gmail.com>
Subject Review Request: Add load average support to TaskTrackerStatus
Date Mon, 01 Nov 2010 20:05:15 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/20/
-----------------------------------------------------------

Review request for hadoop-mapreduce and Dhruba Borthakur.


Summary
-------

Extend TaskTrackerStatus.ResourceStatus and ResourceCalculatorPlugin to allow for sending
last-one-minute load average reports.

Here's a link on load and how they could help with scheduling: http://en.wikipedia.org/wiki/Load_(computing)


Diffs
-----

  /trunk/src/java/org/apache/hadoop/mapred/TaskTrackerStatus.java 1029240 
  /trunk/src/java/org/apache/hadoop/mapreduce/util/LinuxResourceCalculatorPlugin.java 1029240

  /trunk/src/java/org/apache/hadoop/mapreduce/util/ResourceCalculatorPlugin.java 1029240 
  /trunk/src/test/mapred/org/apache/hadoop/mapred/DummyResourceCalculatorPlugin.java 1029240

  /trunk/src/test/mapred/org/apache/hadoop/mapred/TestTTResourceReporting.java 1029240 
  /trunk/src/test/mapred/org/apache/hadoop/mapreduce/util/TestLinuxResourceCalculatorPlugin.java
1029240 

Diff: https://reviews.apache.org/r/20/diff


Testing
-------

/proc/loadavg is available on all GNU/Linux systems.

Post editing and recompiling, "ant clean; ant test" passes.

I've added a test case for the Linux plugin, and also extended the existing TT Reporting test
to beam out and receive load averages. Please let me know if I need to add any more tests.


Thanks,

Harsh


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message