hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vaibhav Gumashta (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-13776) MCSK repair fails for some tables with MetaException(message:Expected 1 components, got 3 (timestamp=2015-05-01/type=open/num=1))
Date Tue, 17 May 2016 18:32:12 GMT

     [ https://issues.apache.org/jira/browse/HIVE-13776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Vaibhav Gumashta updated HIVE-13776:
------------------------------------
    Description: 
We're seeing msck repair fail randomly for a directory layout like this:

{code}
/table/timestamp=2015-05-01
/table/timestamp=2015-05-01/type=open
/table/timestamp=2015-05-01/type=open/num=1/file-1
/table/timestamp=2015-05-01/type=open/num=1/file-2
{code}

The table is partitioned by timestamp (date), type (string) and num (integer). Running MCSK
repair succeeds for some files, but intermittently throws an exception like this:
{code}
MCSK repair fails for some tables with MetaException(message:Expected 1 components, got 3
(timestamp=2015-05-01/type=open/num=1))
{code}

Appears that there is a bug in DDLTask.mcsk (https://github.com/apache/hive/blob/6cb5dbe64968f052266f491492225e925e437dac/ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java#L1832).


  was:
We're seeing msck repair fail randomly for a directory layout like this:

{code}
/table/timestamp=2015-05-01
/table/timestamp=2015-05-01/type=open
/table/timestamp=2015-05-01/type=open/num=1/file-1
/table/timestamp=2015-05-01/type=open/num=1/file-2
{code}

The table is partitioned by timestamp (date), type (string) and num (integer).
Appears that there is a bug in DDLTask.mcsk (https://github.com/apache/hive/blob/6cb5dbe64968f052266f491492225e925e437dac/ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java#L1832).



> MCSK repair fails for some tables with MetaException(message:Expected 1 components, got
3 (timestamp=2015-05-01/type=open/num=1))
> ---------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-13776
>                 URL: https://issues.apache.org/jira/browse/HIVE-13776
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 1.2.1
>            Reporter: Vaibhav Gumashta
>
> We're seeing msck repair fail randomly for a directory layout like this:
> {code}
> /table/timestamp=2015-05-01
> /table/timestamp=2015-05-01/type=open
> /table/timestamp=2015-05-01/type=open/num=1/file-1
> /table/timestamp=2015-05-01/type=open/num=1/file-2
> {code}
> The table is partitioned by timestamp (date), type (string) and num (integer). Running
MCSK repair succeeds for some files, but intermittently throws an exception like this:
> {code}
> MCSK repair fails for some tables with MetaException(message:Expected 1 components, got
3 (timestamp=2015-05-01/type=open/num=1))
> {code}
> Appears that there is a bug in DDLTask.mcsk (https://github.com/apache/hive/blob/6cb5dbe64968f052266f491492225e925e437dac/ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java#L1832).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message