hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Hadoop Wiki] Update of "ProtocolBuffers" by SteveLoughran
Date Wed, 19 Oct 2011 09:42:48 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.

The "ProtocolBuffers" page has been changed by SteveLoughran:

  Hadoop 0.23+ requires the protocol buffers JAR (protobufs.jar) to be on the classpath of
both clients and servers; the native binaries are required to compile this and later versions
of Hadoop.
- In comparison with previous IDLs (such as CORBA, DCOM and !SunOS RPC), !ProtocolBuffers
are designed to be
+ In comparison with previous IDLs (such as CORBA, DCOM and SunOS RPC), !ProtocolBuffers are
designed to be
   * Simple remote procedure calls (not Object-Oriented communication in the style of CORBA).
   * Usable for efficient binary serialization of raw data.
   * Highly efficient in terms of bandwidth, serialization and deserialization. In a large
Hadoop cluster, network bandwidth, especially to and from the NameNode, JobTracker and -in
NextGenMapReduce-, the ResourceManager, is precious. An efficient wire format not only saves
bandwidth to and from these master nodes, it can reduce load and congestion on the main switching
fabric of a large cluster. 

View raw message