drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jacques Nadeau (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (DRILL-3720) Avro Record Reader should process Avro files by per block basis
Date Mon, 14 Sep 2015 05:31:46 GMT

     [ https://issues.apache.org/jira/browse/DRILL-3720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jacques Nadeau resolved DRILL-3720.
-----------------------------------
    Resolution: Fixed

Merged in 8f4ca6e

> Avro Record Reader should process Avro files by per block basis
> ---------------------------------------------------------------
>
>                 Key: DRILL-3720
>                 URL: https://issues.apache.org/jira/browse/DRILL-3720
>             Project: Apache Drill
>          Issue Type: Improvement
>          Components: Storage - Other
>    Affects Versions: 1.0.0, 1.1.0
>            Reporter: Bhallamudi Venkata Siva Kamesh
>            Assignee: Jacques Nadeau
>             Fix For: 1.2.0
>
>
> Currently Avro Record Reader processes entire file in single drill bit. This is fine
as long as files are of size HDFS block size. However, if the size of the file is *large*,
it causes a lot of performance issues. 
> To address this, Avro Record Reader should process Avro files by per block basis.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message