spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sean Owen <so...@cloudera.com>
Subject Re: the dependence length of RDD, can its size be greater than 1 pleaae?
Date Thu, 15 Jun 2017 08:13:11 GMT
Yes. Imagine an RDD that results from a union of other RDDs.

On Thu, Jun 15, 2017, 09:11 萝卜丝炒饭 <1427357147@qq.com> wrote:

> Hi all,
>
> The RDD code keeps a member as below:
> dependencies_ : seq[Dependency[_]]
>
> It is a seq, that means it can keep more than one dependency.
>
> I have an issue about this.
> Is it possible that its size is greater than one please?
> If yes, how to produce it please? Would you like show me some code please?
>
> thanks
> Robin Shao
>

Mime
View raw message