hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eugene Koifman (JIRA)" <>
Subject [jira] [Commented] (HIVE-17214) check/fix conversion of unbucketed non-acid to acid
Date Mon, 16 Oct 2017 18:25:00 GMT


Eugene Koifman commented on HIVE-17214:

yes.  I always meant for these more complicated layouts to work - now I know they do

> check/fix conversion of unbucketed non-acid to acid
> ---------------------------------------------------
>                 Key: HIVE-17214
>                 URL:
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Transactions
>            Reporter: Eugene Koifman
>            Assignee: Eugene Koifman
>            Priority: Minor
>         Attachments: HIVE-17214.01.patch
> bucketed tables have stricter rules for file layout on disk - bucket files are direct
children of a partition directory.
> for un-bucketed tables I'm not sure there are any rules
> for example, CTAS with Tez + Union operator creates 1 directory for each leg of the union
> Supposedly Hive can read table by picking all files recursively.  
> Can it also write (other than CTAS example above) arbitrarily?
> Does it mean Acid write can also write anywhere?
> Figure out what can be supported and how can existing layout can be checked?  Examining
a full "ls -l -R" for a large table could be expensive. 

This message was sent by Atlassian JIRA

View raw message