incubator-giraph-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From jgho...@apache.org
Subject svn commit: r1180282 - in /incubator/giraph/trunk: CHANGELOG README src/site/xdoc/index.xml
Date Sat, 08 Oct 2011 00:26:03 GMT
Author: jghoman
Date: Sat Oct  8 00:26:01 2011
New Revision: 1180282

URL: http://svn.apache.org/viewvc?rev=1180282&view=rev
Log:
GIRAPH-44: Add documentation about counter limits in Hadoop 0.203+. Contributed by Mitul Tiwari.

Modified:
    incubator/giraph/trunk/CHANGELOG
    incubator/giraph/trunk/README
    incubator/giraph/trunk/src/site/xdoc/index.xml

Modified: incubator/giraph/trunk/CHANGELOG
URL: http://svn.apache.org/viewvc/incubator/giraph/trunk/CHANGELOG?rev=1180282&r1=1180281&r2=1180282&view=diff
==============================================================================
--- incubator/giraph/trunk/CHANGELOG (original)
+++ incubator/giraph/trunk/CHANGELOG Sat Oct  8 00:26:01 2011
@@ -2,6 +2,9 @@ Giraph Change Log
 
 Release 0.70.0 - unreleased
 
+  GIRAPH-44. Add documentation about counter limits in Hadoop 0.203+.
+  (mtiwari via jghoman)
+
   GIRAPH-12: Investigate communication improvements. (hyunsik)
 
   GIRAPH-46: Race condition on superstep 1 with RPC servers not

Modified: incubator/giraph/trunk/README
URL: http://svn.apache.org/viewvc/incubator/giraph/trunk/README?rev=1180282&r1=1180281&r2=1180282&view=diff
==============================================================================
--- incubator/giraph/trunk/README (original)
+++ incubator/giraph/trunk/README Sat Oct  8 00:26:01 2011
@@ -75,3 +75,12 @@ additional arguments '-Dhadoop=facebook'
 'hadoop_facebook' as well as a location for the hadoop core jar file.  An
 example compilation command is 'mvn -Dhadoop=facebook
 -Dhadoop.jar.path=/tmp/hadoop-0.20.1-core.jar compile'.
+
+
+Notes: 
+Counter limit: In Hadoop 0.20.203.0 onwards, there is a limit on the number of
+counters one can use, which is set to 120 by default. This limit restricts the
+number of iterations/supersteps possible in Giraph. This limit can be increased
+by setting a parameter "mapreduce.job.counters.limit" in job tracker's config
+file mapred-site.xml.
+

Modified: incubator/giraph/trunk/src/site/xdoc/index.xml
URL: http://svn.apache.org/viewvc/incubator/giraph/trunk/src/site/xdoc/index.xml?rev=1180282&r1=1180281&r2=1180282&view=diff
==============================================================================
--- incubator/giraph/trunk/src/site/xdoc/index.xml (original)
+++ incubator/giraph/trunk/src/site/xdoc/index.xml Sat Oct  8 00:26:01 2011
@@ -66,5 +66,8 @@ under the License.
 		 'hadoop_non_secure'.  An example compilation command is
 		'mvn -Dhadoop=non_secure compile'.</p>
 	</section>
+  <section name="Notes">
+      Counter limit: In Hadoop 0.20.203.0 onwards, there is a limit on the number of counters
one can use, which is set to 120 by default. This limit restricts the number of iterations/supersteps
possible in Giraph. This limit can be increased by setting a parameter "mapreduce.job.counters.limit"
in job tracker's config file mapred-site.xml.
+  </section>
   </body>
 </document>



Mime
View raw message