drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bhallamudi Venkata Siva Kamesh (JIRA)" <j...@apache.org>
Subject [jira] [Created] (DRILL-3720) Avro Record Reader should process Avro files by per block basis
Date Fri, 28 Aug 2015 09:50:45 GMT
Bhallamudi Venkata Siva Kamesh created DRILL-3720:
-----------------------------------------------------

             Summary: Avro Record Reader should process Avro files by per block basis
                 Key: DRILL-3720
                 URL: https://issues.apache.org/jira/browse/DRILL-3720
             Project: Apache Drill
          Issue Type: Improvement
          Components: Storage - Other
    Affects Versions: 1.1.0, 1.0.0
            Reporter: Bhallamudi Venkata Siva Kamesh
            Assignee: Jacques Nadeau
             Fix For: 1.2.0


Currently Avro Record Reader processes entire file in single drill bit. This is fine as long
as files are of size HDFS block size. However, if the size of the file is *large*, it causes
a lot of performance issues. 

To address this, Avro Record Reader should process Avro files by per block basis.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message