avro-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Doug Cutting (JIRA)" <j...@apache.org>
Subject [jira] Created: (AVRO-24) benchmark bulk data
Date Mon, 27 Apr 2009 20:03:31 GMT
benchmark bulk data

                 Key: AVRO-24
                 URL: https://issues.apache.org/jira/browse/AVRO-24
             Project: Avro
          Issue Type: Task
          Components: java
            Reporter: Doug Cutting
            Assignee: Doug Cutting
             Fix For: 1.0

It would be good to validate that the RPC wire format is capable of transmitting bulk data
efficiently.  In particular, to be used for HDFS file access, it must be able to, when including
file data in an RPC response, or writing file data in an RPC request:
 - saturate a disk's throughput or a network interface; and
 - not consume much CPU.
In other words, Avro's RPC should not be a bottleneck in the transfer of file data from a
remote disk to an application or vice versa, and moreover it should leave the vast majority
of the CPU for the application.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message