spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrew Ash <and...@andrewash.com>
Subject Re: The performance of group operation on SSD
Date Fri, 17 Jan 2014 16:01:10 GMT
Are there different amounts of RAM on the SSD machines vs the Spinny disk
machines?

Sent from my mobile phone
On Jan 17, 2014 5:22 AM, "Jay" <hjayin@gmail.com> wrote:

> OS memory cache??
>
> Sent from my iPad.
>
> > 在 2014年1月16日,上午6:04,Chen Jin <karen.cj@gmail.com> 写道:
> >
> > Dear Spark developers:
> >
> > We are benchmarking spark operations such as filter, group, join on
> > ssd instance i2.2xlarge on EC2. Most operations are similar or
> > slightly better than ephemeral disks on EC2, however, the performance
> > of group operation on SDD  are much worse than regular disks, at least
> > 2x to 3x worse. Could any of you shed some lights on this behavior?
> >
> > Thanks a lot,
> >
> > -chen
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message