hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Elser (JIRA)" <>
Subject [jira] [Commented] (HIVE-7984) Configuration items from StorageHandler not passed to Tez Configuration
Date Fri, 05 Sep 2014 02:49:24 GMT


Josh Elser commented on HIVE-7984:

After a bunch of digging, I found that I could still work around this via the custom OutputFormat
for Accumulo without having to actually dig into the calls to the StorageHandler WRT to the
execution engine.

> Configuration items from StorageHandler not passed to Tez Configuration
> -----------------------------------------------------------------------
>                 Key: HIVE-7984
>                 URL:
>             Project: Hive
>          Issue Type: Bug
>          Components: StorageHandler, Tez
>            Reporter: Josh Elser
>            Assignee: Josh Elser
>             Fix For: 0.14.0
> Ran AccumuloStorageHandler queries with Tez and found that configuration elements that
are pulled from the {{-hiveconf}} and passed to the inputJobProperties or outputJobProperties
by the AccumuloStorageHandler aren't available inside of the Tez container.
> I'm guessing that there is a disconnect from the configuration that the StorageHandler
creates and what the Tez container sees.
> The HBaseStorageHandler likely doesn't run into this because it expects to have hbase-site.xml
available via tmpjars (and can extrapolate connection information from that file). Accumulo's
site configuration file is not meant to be shared with consumers which means that this exact
approach is not sufficient.

This message was sent by Atlassian JIRA

View raw message