Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 2ECFB200CA8 for ; Thu, 15 Jun 2017 10:13:37 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 2D50A160BDF; Thu, 15 Jun 2017 08:13:37 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 74321160BC4 for ; Thu, 15 Jun 2017 10:13:36 +0200 (CEST) Received: (qmail 41563 invoked by uid 500); 15 Jun 2017 08:13:31 -0000 Mailing-List: contact dev-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list dev@spark.apache.org Received: (qmail 40786 invoked by uid 99); 15 Jun 2017 08:13:31 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 15 Jun 2017 08:13:31 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id D3E89188A5E for ; Thu, 15 Jun 2017 08:13:30 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.979 X-Spam-Level: * X-Spam-Status: No, score=1.979 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=cloudera-com.20150623.gappssmtp.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id VvazgcgayJvp for ; Thu, 15 Jun 2017 08:13:29 +0000 (UTC) Received: from mail-ua0-f179.google.com (mail-ua0-f179.google.com [209.85.217.179]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 245395FD83 for ; Thu, 15 Jun 2017 08:13:29 +0000 (UTC) Received: by mail-ua0-f179.google.com with SMTP id 68so4115089uas.0 for ; Thu, 15 Jun 2017 01:13:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cloudera-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=3H5+4IFKsseNyxdzzCmuwzB7v+IXbRLh0U4KDc1b5Xo=; b=eeKYWyl36Uq5RMdeGFKdufMv6PlugPa/MMjvQN3WMQ2ENRYYvLRbCac8uS+ZH6vXRw eRdcxf2A4CEkqhI17Ggh9IoN6UFMOXkT7difhtO8L42MPyrYfYmwgkc6IAbLF0rgtwM4 5gFF9mk/8jgs3FoF8zz9rKGDOOpa6aPuXERk0gDJNtDjTu3kjsVbHqYvxuvoEjZNqMEQ dShB48gBj75f+fIh3l7HXtGr8nWjI3Gg+3Na9FkCpZoewOWaNy7J9WHMq2J8N1wzy7+R o3eJAGqKMhWiiNMUm3d934LmeLyd/w/TM5yzpOf+5CMuitbZjCP0dhCkiPr5qrP5Dg21 ReDw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=3H5+4IFKsseNyxdzzCmuwzB7v+IXbRLh0U4KDc1b5Xo=; b=lnif7yR7jZVs3YDkOE4se0RBlx4B5HmtvsVDHkHUcEPwjEzjGlvcxFir9fGqIWwxeW tfdq0nBhADKCNLzprwTbFlFpOs3fulr29U1+55MM9NQ4Qnn8O2Z+6sl8UAg5lZqGZAPr STam+67+8eLAIyVV8sr7ap+SX5Xhd3v+rPIpGh/Zvyx97fbE8xmFIsqZBAjqAW3Sb1WH r8rm8fCeABk0n78kKVUWsaSLCd8CooyY84aSa2MSt9+WX8s++8OS+kv1xaiWDkkusO7X TjoG5+npKjX109mBp01vppQ16gg4rUiEkwSMETxe97bXQX8FAvlfvMKGz8NmlmPHPuJF DJEQ== X-Gm-Message-State: AKS2vOyXu7aOjF/BmTPgMhXBseIMiUJNJCdQasDB8hCE2WkW+UKFi/N7 XpdDmxXfDJ7fzQHmPUBqZco3rn0c/Z2o X-Received: by 10.159.48.89 with SMTP id i25mr2321258uab.123.1497514401914; Thu, 15 Jun 2017 01:13:21 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Sean Owen Date: Thu, 15 Jun 2017 08:13:11 +0000 Message-ID: Subject: Re: the dependence length of RDD, can its size be greater than 1 pleaae? To: =?UTF-8?B?6JCd5Y2c5Lid54KS6aWt?= <1427357147@qq.com>, user , dev Content-Type: multipart/alternative; boundary="f403045e3ae8f9072d0551fb3d71" archived-at: Thu, 15 Jun 2017 08:13:37 -0000 --f403045e3ae8f9072d0551fb3d71 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Yes. Imagine an RDD that results from a union of other RDDs. On Thu, Jun 15, 2017, 09:11 =E8=90=9D=E5=8D=9C=E4=B8=9D=E7=82=92=E9=A5=AD <= 1427357147@qq.com> wrote: > Hi all, > > The RDD code keeps a member as below: > dependencies_ : seq[Dependency[_]] > > It is a seq, that means it can keep more than one dependency. > > I have an issue about this. > Is it possible that its size is greater than one please? > If yes, how to produce it please? Would you like show me some code please= ? > > thanks > Robin Shao > --f403045e3ae8f9072d0551fb3d71 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Yes. Imagine an RDD that results from a union of other RDDs.

On Thu, Jun 15, 2017, 09:11 =E8=90=9D= =E5=8D=9C=E4=B8=9D=E7=82=92=E9=A5=AD <1427357147@qq.com> wrote:
Hi all,

The RDD code keeps a member as below= :
dependencies_ : seq[Dependency[_]]

It = is a seq, that means it can keep more than one dependency.

I have an issue about this.
Is it possible that its size= is greater than one please?
If yes, how to produce it please? Wo= uld you like show me some code please?

thanks=C2= =A0
Robin=C2=A0Shao
--f403045e3ae8f9072d0551fb3d71--