spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From harishreedharan <...@git.apache.org>
Subject [GitHub] spark pull request: Common interfaces between RDD, DStream, and Da...
Date Mon, 20 Apr 2015 18:22:21 GMT
Github user harishreedharan commented on the pull request:

    https://github.com/apache/spark/pull/5565#issuecomment-94529830
  
    I agree that they should have been unified from the beginning, but at this point merging
the two APIs into one would have to be done when we can break version compat. I'd still like
to have something like `DStream.map` (in fact, DStream could really have been an RDD implementation
itself, so we didn't have multiple implementations).  
    
    At this point, as long as we can unify APIs without breaking them I am ok with it - and
in a future 2.0 release, we can make `DStream` an `RDD` implementation.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


Mime
View raw message