hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sushanth Sowmyan (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-7984) AccumuloOutputFormat Configuration items from StorageHandler not re-set in Configuration in Tez
Date Fri, 19 Sep 2014 07:11:34 GMT

     [ https://issues.apache.org/jira/browse/HIVE-7984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Sushanth Sowmyan updated HIVE-7984:
-----------------------------------
    Resolution: Fixed
        Status: Resolved  (was: Patch Available)

Committed to trunk. Thanks [~elserj]!

> AccumuloOutputFormat Configuration items from StorageHandler not re-set in Configuration
in Tez
> -----------------------------------------------------------------------------------------------
>
>                 Key: HIVE-7984
>                 URL: https://issues.apache.org/jira/browse/HIVE-7984
>             Project: Hive
>          Issue Type: Bug
>          Components: StorageHandler, Tez
>            Reporter: Josh Elser
>            Assignee: Josh Elser
>             Fix For: 0.14.0
>
>         Attachments: HIVE-7984-1.diff, HIVE-7984-1.patch, HIVE-7984.1.patch
>
>
> Ran AccumuloStorageHandler queries with Tez and found that configuration elements that
are pulled from the {{-hiveconf}} and passed to the inputJobProperties or outputJobProperties
by the AccumuloStorageHandler aren't available inside of the Tez container.
> I'm guessing that there is a disconnect from the configuration that the StorageHandler
creates and what the Tez container sees.
> The HBaseStorageHandler likely doesn't run into this because it expects to have hbase-site.xml
available via tmpjars (and can extrapolate connection information from that file). Accumulo's
site configuration file is not meant to be shared with consumers which means that this exact
approach is not sufficient.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message