hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Craig Condit (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-7017) Insertion into Parquet tables fails under Tez
Date Tue, 06 May 2014 19:23:15 GMT

    [ https://issues.apache.org/jira/browse/HIVE-7017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13991025#comment-13991025
] 

Craig Condit commented on HIVE-7017:
------------------------------------

I mistakenly assumed that code came from TEZ, when it in fact exists in Hive...

https://github.com/apache/hive/blob/022ee59b8cb9161996310861d4fbf59801d4b9fe/ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezProcessor.java#L103

Should probably be:

{noformat}
StringBuilder taskAttemptIdBuilder = new StringBuilder("attempt_");
{noformat}

instead of:

{noformat}
StringBuilder taskAttemptIdBuilder = new StringBuilder("task");
{noformat}




> Insertion into Parquet tables fails under Tez
> ---------------------------------------------
>
>                 Key: HIVE-7017
>                 URL: https://issues.apache.org/jira/browse/HIVE-7017
>             Project: Hive
>          Issue Type: Bug
>          Components: Tez
>    Affects Versions: 0.13.0
>         Environment: Hive 0.13.0, CentOS 6
>            Reporter: Craig Condit
>
> It seems Parquet tables cannot be written to in Tez mode. CREATE TABLE foo STORED AS
PARQUET SELECT ... queries fail with:
> {noformat}
> 	java.lang.IllegalArgumentException: TaskAttemptId string : task1396892688715_80817_m_000076_3
is not properly formed
> 		at org.apache.hadoop.mapreduce.TaskAttemptID.forName(TaskAttemptID.java:201)
> 		at org.apache.hadoop.hive.ql.io.parquet.write.ParquetRecordWriterWrapper.<init>(ParquetRecordWriterWrapper.java:49)
> {noformat}
> The same queries work fine after setting hive.execution.engine=mr.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message