hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Patrick Donnelly <batr...@batbytes.com>
Subject Caching in HDFS C API Client
Date Fri, 11 Jun 2010 17:05:42 GMT
Hi List,

I need to explain an higher than expected throughput (bandwidth) for a
HDFS C API Client. Specifically, the client is getting bandwidth
higher than its link rate :). The client is first writing a 512 MB
file followed by reading the entire file back. The file read is what's
getting the higher than link rate bandwidth. I assume this is a
consequence of caching? Is this done by HDFS or by Linux?

Thanks for any help,

- Patrick Donnelly

View raw message