hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Joydeep Sen Sarma (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-1454) insert overwrite and CTAS fail in hive local mode
Date Thu, 08 Jul 2010 20:11:05 GMT

    [ https://issues.apache.org/jira/browse/HIVE-1454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12886442#action_12886442
] 

Joydeep Sen Sarma commented on HIVE-1454:
-----------------------------------------

it's difficult to add queries that can test this. the reason is that we need two different
valid and different Hadoop FileSystems to replicate this problem. this is not trivial.

medium term - as part of HIVE-1408 - i will add a new dummy Hadoop filesystem (that will just
use local storage underneath). Then we will be able to systematically test this using our
regression queries.

> insert overwrite and CTAS fail in hive local mode
> -------------------------------------------------
>
>                 Key: HIVE-1454
>                 URL: https://issues.apache.org/jira/browse/HIVE-1454
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Query Processor
>            Reporter: Joydeep Sen Sarma
>            Assignee: Joydeep Sen Sarma
>            Priority: Blocker
>             Fix For: 0.6.0
>
>         Attachments: hive-1454.1.patch
>
>
> this is because of the changes in HIVE-543. We switched to using local storage for intermediate
data for local mode queries. However there are code paths that are incorrectly allocating
intermediate storage where they should be allocating external file system storage (based on
table/directory uri). This is causing regressions in running queries in local mode.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message