spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Patrick Wendell (JIRA)" <>
Subject [jira] [Commented] (SPARK-1518) Spark master doesn't compile against hadoop-common trunk
Date Mon, 26 May 2014 23:28:01 GMT


Patrick Wendell commented on SPARK-1518:

Hey [~cmccabe], what is the oldest version of hadooop that contains hflush? /cc [~andrewor]
who IIRC looked into this a bunch when writing the logger.

> Spark master doesn't compile against hadoop-common trunk
> --------------------------------------------------------
>                 Key: SPARK-1518
>                 URL:
>             Project: Spark
>          Issue Type: Bug
>            Reporter: Marcelo Vanzin
>            Assignee: Colin Patrick McCabe
> FSDataOutputStream::sync() has disappeared from trunk in Hadoop; FileLogger.scala is
calling it.
> I've changed it locally to hsync() so I can compile the code, but haven't checked yet
whether those are equivalent. hsync() seems to have been there forever, so it hopefully works
with all versions Spark cares about.

This message was sent by Atlassian JIRA

View raw message