hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wasim Bari" <wasimb...@msn.com>
Subject Append Algorithm
Date Tue, 09 Dec 2008 20:52:16 GMT
Hadoop Append (0.19) works in same way as GFS does? 

GFS algorithm is below:

Application originates record append request.

2. GFS client translates request and sends it to master.

3. Master responds with chunk handle and (primary +

secondary) replica locations.

4. Client pushes write data to all locations.

Primary checks if record fits in specified chunk.

6. If record does not fit, then the primary:

. pads the chunk,

. tells secondaries to do the same,

. and informs the client.

. Client then retries the append with the nextchunk.

7. If record fits, then the primary:

. appends the record,

. tells secondaries to do the same,

. receives responses from secondaries,

. and sends final response to the client.


  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message