hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Elser (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-7950) StorageHandler resources aren't added to Tez Session if already Session is already Open
Date Tue, 09 Sep 2014 19:05:28 GMT

    [ https://issues.apache.org/jira/browse/HIVE-7950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14127407#comment-14127407
] 

Josh Elser commented on HIVE-7950:
----------------------------------

Ok, I figured a bit more out here. I believe that the AM *is* correctly getting the extra
jars from the storage handler as expected. The subsequent errors are coming from the containers
that are started to actually run the DAG (rather than the coordination from the tez AM).

The interesting part is that the patch (HIVE-7950-1.diff) which starts a brand new Session
will result in a successful query. It seems like maybe Tez isn't passing along the extra resources
we added to the running session (AM) in Hive along to the DAG containers to actually run the
query. I have no idea at this point if this is a problem in how hive is using tez or if it's
a bug in tez itself...

> StorageHandler resources aren't added to Tez Session if already Session is already Open
> ---------------------------------------------------------------------------------------
>
>                 Key: HIVE-7950
>                 URL: https://issues.apache.org/jira/browse/HIVE-7950
>             Project: Hive
>          Issue Type: Bug
>          Components: StorageHandler, Tez
>            Reporter: Josh Elser
>            Assignee: Josh Elser
>             Fix For: 0.14.0
>
>         Attachments: HIVE-7950-1.diff, hive-7950-tez-WIP.diff
>
>
> Was trying to run some queries using the AccumuloStorageHandler when using the Tez execution
engine. Some things that classes which were added to tmpjars weren't making it into the container.
When a Tez Session is already open, as is the normal case when simply using the `hive` command,
the resources aren't added.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message