hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gunther Hagleitner (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-8631) Compressed transaction list cannot be parsed in job.xml
Date Tue, 28 Oct 2014 17:26:33 GMT

    [ https://issues.apache.org/jira/browse/HIVE-8631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187135#comment-14187135
] 

Gunther Hagleitner commented on HIVE-8631:
------------------------------------------

we've added an option to send the compressed plan via conf to tez. The way we did it there
was to base 64 the compressed string. That should work here too.

Anyways: +1 for the patch to back it out.

> Compressed transaction list cannot be parsed in job.xml
> -------------------------------------------------------
>
>                 Key: HIVE-8631
>                 URL: https://issues.apache.org/jira/browse/HIVE-8631
>             Project: Hive
>          Issue Type: Bug
>          Components: Transactions
>    Affects Versions: 0.14.0
>            Reporter: Alan Gates
>            Assignee: Alan Gates
>            Priority: Blocker
>             Fix For: 0.14.0
>
>         Attachments: HIVE-8631.patch
>
>
> HIVE-8341 added code to compress the transaction list in the JobConf when it reaches
a certain size.  This breaks when the JobConf is converted to job.xml and sent to MR.  The
special characters are not correctly escaped.  
> The proposed fix is to back out the compression (not the changes to ScriptOperator) for
now and look later at compressing/encoding it in a way that works with job.xml.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message