hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gang Tim Liu (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-3734) Static partition DML create duplicate files and records
Date Thu, 22 Nov 2012 02:04:58 GMT

     [ https://issues.apache.org/jira/browse/HIVE-3734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Gang Tim Liu updated HIVE-3734:
-------------------------------

    Description: 
Static DML create duplicate files and record.

Given the attached test case, hive will return 2 records:
484	val_484
484	val_484

but srcpart returns one record:
484	val_484

If you look at file system, DML generates duplicate file with the same content:
-rw-r--r-- 1 gang THEFACEBOOK\Domain Users 5812 Nov 21 17:55 000000_0
-rwxr-xr-x 1 gang THEFACEBOOK\Domain Users 5812 Nov 21 17:55 000001_0


  was:
Static DML create duplicate files and record.

Given the attached test case, hive will return 2 records:
484	val_484
484	val_484

but srcpart returns one record:
484	val_484

If you look at file system, DML generates duplicate file.


    
> Static partition DML create duplicate files and records
> -------------------------------------------------------
>
>                 Key: HIVE-3734
>                 URL: https://issues.apache.org/jira/browse/HIVE-3734
>             Project: Hive
>          Issue Type: Bug
>          Components: Query Processor
>    Affects Versions: 0.10.0
>            Reporter: Gang Tim Liu
>
> Static DML create duplicate files and record.
> Given the attached test case, hive will return 2 records:
> 484	val_484
> 484	val_484
> but srcpart returns one record:
> 484	val_484
> If you look at file system, DML generates duplicate file with the same content:
> -rw-r--r-- 1 gang THEFACEBOOK\Domain Users 5812 Nov 21 17:55 000000_0
> -rwxr-xr-x 1 gang THEFACEBOOK\Domain Users 5812 Nov 21 17:55 000001_0

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message