hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "BELUGA BEHR (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-16856) Allow For Customization Of Buffer Size In MapJoinTableContainerSerDe
Date Thu, 08 Jun 2017 04:02:18 GMT

     [ https://issues.apache.org/jira/browse/HIVE-16856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

BELUGA BEHR updated HIVE-16856:
-------------------------------
    Description: 
MapJoinTableContainerSerDe currently hard-codes the buffer sizes as 4K.  If we remove the
explicit buffer size, it will fall back to using the customized buffer size (or 4K):

{code}
   public FSDataInputStream open(Path f) throws IOException {
     return open(f, getConf().getInt("io.file.buffer.size", 4096));
   }
{code}

  was:
MapJoinTableContainerSerDe currently hard-codes the buffer sizes as 4K.  If we remove the
explicit buffer size, it will fall back to using the customized buffer size (or 4K):

{code}
   public FSDataInputStream More ...open(Path f) throws IOException {
     return open(f, getConf().getInt("io.file.buffer.size", 4096));
   }
{code}


> Allow For Customization Of Buffer Size In MapJoinTableContainerSerDe
> --------------------------------------------------------------------
>
>                 Key: HIVE-16856
>                 URL: https://issues.apache.org/jira/browse/HIVE-16856
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: BELUGA BEHR
>            Priority: Trivial
>         Attachments: HIVE-16856.1.patch
>
>
> MapJoinTableContainerSerDe currently hard-codes the buffer sizes as 4K.  If we remove
the explicit buffer size, it will fall back to using the customized buffer size (or 4K):
> {code}
>    public FSDataInputStream open(Path f) throws IOException {
>      return open(f, getConf().getInt("io.file.buffer.size", 4096));
>    }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message