mesos-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tim St Clair <tstcl...@redhat.com>
Subject Re: 0.21.0-pre & Spark latest
Date Tue, 28 Oct 2014 15:03:38 GMT
inline 

----- Original Message -----

> From: "Brenden Matthews" <brenden.matthews@airbedandbreakfast.com>
> To: user@mesos.apache.org
> Cc: "mesos-devel" <dev@mesos.apache.org>, "RJ Nowling" <rnowling@redhat.com>,
> "Erik Erlandson" <eje@redhat.com>
> Sent: Tuesday, October 28, 2014 9:51:58 AM
> Subject: Re: 0.21.0-pre & Spark latest

> Since we've recently adopted Spark, I'll second Tim's comment. We had an
> issue with 0.20.1 that was possibly related to Spark[1], so it's important
> for us to get this stuff fixed in 0.21.0.

> Tim, can you elaborate on the issues you saw? Have you tested with my recent
> Spark patches[2][3]?

We are building against Spark 1.1.0 unpatched: 
- Fine grained mode appears broken. 

- Course grained mode appears to work via normal runs, but crashes in the REPL. 
http://fpaste.org/145782/14506564/ 

> [1]: https://issues.apache.org/jira/browse/MESOS-1973
> [2]: https://github.com/apache/spark/pull/2401
> [3]: https://github.com/apache/spark/pull/2453

> On Tue, Oct 28, 2014 at 7:46 AM, Tim St Clair < tstclair@redhat.com > wrote:

> > Folks -
> 

> > We have some automated tests that run the latest Mesos against the latest
> > Spark, and we've run across a series of issues in both fine, and course
> > grained mode that I believe stem from a series of changes in the 0.21
> > cycle.
> 

> > I'm not certain if anyone "owns" this integration, but we should probably
> > ensure it's fixed before we push out 0.21.
> 

> > --
> 
> > Cheers,
> 
> > Timothy St. Clair
> 
> > Red Hat Inc.
> 

-- 
Cheers, 
Timothy St. Clair 
Red Hat Inc. 

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message