spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Patrick Wendell (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-1518) Spark master doesn't compile against hadoop-common trunk
Date Mon, 26 May 2014 23:28:01 GMT

    [ https://issues.apache.org/jira/browse/SPARK-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14009135#comment-14009135
] 

Patrick Wendell commented on SPARK-1518:
----------------------------------------

Hey [~cmccabe], what is the oldest version of hadooop that contains hflush? /cc [~andrewor]
who IIRC looked into this a bunch when writing the logger.

> Spark master doesn't compile against hadoop-common trunk
> --------------------------------------------------------
>
>                 Key: SPARK-1518
>                 URL: https://issues.apache.org/jira/browse/SPARK-1518
>             Project: Spark
>          Issue Type: Bug
>            Reporter: Marcelo Vanzin
>            Assignee: Colin Patrick McCabe
>
> FSDataOutputStream::sync() has disappeared from trunk in Hadoop; FileLogger.scala is
calling it.
> I've changed it locally to hsync() so I can compile the code, but haven't checked yet
whether those are equivalent. hsync() seems to have been there forever, so it hopefully works
with all versions Spark cares about.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message