hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Brock Noland (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-7614) Find solution for closures containing writables
Date Tue, 05 Aug 2014 07:12:12 GMT

    [ https://issues.apache.org/jira/browse/HIVE-7614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085911#comment-14085911
] 

Brock Noland commented on HIVE-7614:
------------------------------------

Warts for all three:

1. Is expensive and is likely a "worst case" scenario.
2. Has known [problems|http://mail-archives.apache.org/mod_mbox/spark-dev/201405.mbox/%3CCAPh_B=Z3mNZp4A=B3M9TnQqe6n+foB6fQSmLEkVwB+mUbb=Akg@mail.gmail.com%3E]
but it's not known if those are solvable
3. Is a point solution and would require an unknown number of classes in Spark to be modified.

> Find solution for closures containing writables
> -----------------------------------------------
>
>                 Key: HIVE-7614
>                 URL: https://issues.apache.org/jira/browse/HIVE-7614
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Spark
>            Reporter: Brock Noland
>            Priority: Blocker
>
> HIVE-7540 performed a workaround so we could serialize closures with Writables. However,
we need a long term solution.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message