hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ryan Rosario <uclamath...@gmail.com>
Subject Reading Global Counters in Streaming?
Date Mon, 14 Nov 2011 18:51:25 GMT

I am writing a Hadoop Streaming job in Python. I know that I can
increment counters by writing a special format to sys.stderr. Is it
possible to *read* the values of counters from my Python program? I am
using the global counter as the denominator of a probability, and must
have this value available to all reducers. Is this possible, and how
would I do it in Python?


View raw message