hadoop-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From George Porter <George.Por...@Sun.COM>
Subject Re: [PROPOSAL] new subproject: Avro
Date Mon, 06 Apr 2009 21:02:28 GMT
> Unfortunately, that patch stalled awaiting benchmarks, and now is  
> stale.  Avro currently specifies a request and response payload  
> format, but does not say much about metadata.  In an HTTP-based  
> transport, tracing might be done through headers.  As we adapt  
> Hadoop's optimized RPC transport to support Avro messages we should  
> probably insert a generic metadata layer, analogous to HTTP's  
> headers, to support features such as this.
> Doug


This would be great.  While it is always possible to add extension  
data to the payload itself, having such support in the transport  
itself can be quite useful, in my opinion.  Especially if there are a  
variety of different payloads, you don't have to extend each one.


View raw message