spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Michael Armbrust (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-1494) Hive Dependencies being checked by MIMA
Date Sat, 10 May 2014 21:58:45 GMT

    [ https://issues.apache.org/jira/browse/SPARK-1494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13993914#comment-13993914
] 

Michael Armbrust commented on SPARK-1494:
-----------------------------------------

I think this is fixed now that MIMA loads classes passing false to "initialize".

> Hive Dependencies being checked by MIMA
> ---------------------------------------
>
>                 Key: SPARK-1494
>                 URL: https://issues.apache.org/jira/browse/SPARK-1494
>             Project: Spark
>          Issue Type: Bug
>          Components: Project Infra, SQL
>    Affects Versions: 1.0.0
>            Reporter: Ahir Reddy
>            Assignee: Michael Armbrust
>            Priority: Minor
>             Fix For: 1.0.0
>
>
> It looks like code in companion objects is being invoked by the MIMA checker, as it uses
Scala reflection to check all of the interfaces. As a result it's starting a Spark context
and eventually out of memory errors. As a temporary fix all classes that contain "hive" or
"Hive" are excluded from the check.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message