spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinay Shukla (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-6646) Spark 2.0: Rearchitecting Spark for Mobile Platforms
Date Wed, 01 Apr 2015 16:38:53 GMT

    [ https://issues.apache.org/jira/browse/SPARK-6646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390950#comment-14390950
] 

Vinay Shukla commented on SPARK-6646:
-------------------------------------

This use case can benefit from running Spark inside a Mobile App Server. An App server that
takes care of horizontal issues such as security, networking, etc will allow Spark to focus
on the real hard problem of data processing in a lightening fast manner.

There is another idea of using having Spark leverage [parallel quantum computing | http://people.csail.mit.edu/nhm/pqc.pdf]
but I suppose that calls for another JIRA.

> Spark 2.0: Rearchitecting Spark for Mobile Platforms
> ----------------------------------------------------
>
>                 Key: SPARK-6646
>                 URL: https://issues.apache.org/jira/browse/SPARK-6646
>             Project: Spark
>          Issue Type: Improvement
>          Components: Project Infra
>            Reporter: Reynold Xin
>            Assignee: Reynold Xin
>            Priority: Blocker
>         Attachments: Spark on Mobile - Design Doc - v1.pdf
>
>
> Mobile computing is quickly rising to dominance, and by the end of 2017, it is estimated
that 90% of CPU cycles will be devoted to mobile hardware. Spark’s project goal can be accomplished
only when Spark runs efficiently for the growing population of mobile users.
> Designed and optimized for modern data centers and Big Data applications, Spark is unfortunately
not a good fit for mobile computing today. In the past few months, we have been prototyping
the feasibility of a mobile-first Spark architecture, and today we would like to share with
you our findings. This ticket outlines the technical design of Spark’s mobile support, and
shares results from several early prototypes.
> Mobile friendly version of the design doc: https://databricks.com/blog/2015/04/01/spark-2-rearchitecting-spark-for-mobile.html



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message