Return-Path: X-Original-To: apmail-spark-user-archive@minotaur.apache.org Delivered-To: apmail-spark-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id CC13D182CA for ; Fri, 2 Oct 2015 11:24:12 +0000 (UTC) Received: (qmail 60560 invoked by uid 500); 2 Oct 2015 11:24:09 -0000 Delivered-To: apmail-spark-user-archive@spark.apache.org Received: (qmail 60425 invoked by uid 500); 2 Oct 2015 11:24:04 -0000 Mailing-List: contact user-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@spark.apache.org Received: (qmail 60415 invoked by uid 99); 2 Oct 2015 11:24:04 -0000 Received: from Unknown (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 02 Oct 2015 11:24:04 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 453191A07FC for ; Fri, 2 Oct 2015 11:24:04 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.899 X-Spam-Level: ** X-Spam-Status: No, score=2.899 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=3, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (1024-bit key) header.d=adobe.com Received: from mx1-us-east.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id d2KlV0_OYhGM for ; Fri, 2 Oct 2015 11:23:52 +0000 (UTC) Received: from na01-by2-obe.outbound.protection.outlook.com (mail-by2on0070.outbound.protection.outlook.com [207.46.100.70]) by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) with ESMTPS id 0784342BA0 for ; Fri, 2 Oct 2015 11:23:52 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=adobe.com; s=selector1; h=From:To:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=xVCB4t6E7TiGKlkG9P+FgoEWtdC47FFAJg4vJM7Ku1M=; b=Uzl5+QK+jN+pUivqowejv3bjl/1024qBPUrdOt1TEPb8jmf/EwlptBbXrDasbNP4AnlxaEXFvn+sXYjSr8I7PBZIkUe2XdzVPsp3ag/FMdlm9ryr63vRCba5k+3IP+D3ngw5Kwap1ML0GzVKTCDztNydTVrwUQR4XtxPUu9oNj8= Received: from BY2PR02MB1702.namprd02.prod.outlook.com (10.163.27.28) by BY2PR02MB1701.namprd02.prod.outlook.com (10.163.27.27) with Microsoft SMTP Server (TLS) id 15.1.280.20; Fri, 2 Oct 2015 11:23:44 +0000 Received: from BY2PR02MB1702.namprd02.prod.outlook.com ([10.163.27.28]) by BY2PR02MB1702.namprd02.prod.outlook.com ([10.163.27.28]) with mapi id 15.01.0280.021; Fri, 2 Oct 2015 11:23:44 +0000 From: Adrian Tanase To: "Saif.A.Ellafi@wellsfargo.com" , "user@spark.apache.org" Subject: Re: Accumulator of rows? Thread-Topic: Accumulator of rows? Thread-Index: AdD8eQkDoRseBZOGS120xm2OkKsiAQApO5cA Date: Fri, 2 Oct 2015 11:23:44 +0000 Message-ID: <8BBC227A-682B-47C3-8771-D10100A029E9@adobe.com> References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: user-agent: Microsoft-MacOutlook/15.9.0.150408 authentication-results: spf=none (sender IP is ) smtp.mailfrom=atanase@adobe.com; x-ms-exchange-messagesentrepresentingtype: 1 x-originating-ip: [193.105.140.131] x-microsoft-exchange-diagnostics: 1;BY2PR02MB1701;5:VbkbNt2a75v8NLLcztu+6/2V6Ht1397KRG+xPl2lG/aWYfR1vZCgcT869MK/iDxkgou/7F9YypNvCDMw5zfQRyNXP32AF2vH6qUFTtePaBUibwAnXfsha6B80R7sYS+KtOOfRaxUupawKAIA7ufYUw==;24:GzMgnD2b2U6DP2aYXyTAp+uPoN3ma+kgerqxFd8u5B6Ajn68tqWTqg+HkIhPUsAlxOgShfehm9/FKRmIN+94rjLZqGnZjtQie2cnJ9bxMLc=;20:+AdApblp6DTRsaq9Xd9n+yvi90TI1+Tdl5lXham65ubsrdVvsLhlFXDW0orUDDQwjG/DXxrDCQyh8jz9DouiiQ== x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:BY2PR02MB1701; x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:; x-exchange-antispam-report-cfa-test: BCL:0;PCL:0;RULEID:(61425024)(601004)(2401047)(5005006)(520078)(8121501046)(3002001)(61426024)(61427024);SRVR:BY2PR02MB1701;BCL:0;PCL:0;RULEID:;SRVR:BY2PR02MB1701; x-forefront-prvs: 0717E25089 x-forefront-antispam-report: SFV:NSPM;SFS:(10009020)(164054003)(189002)(199003)(377454003)(53754006)(97736004)(33656002)(5001770100001)(46102003)(81156007)(101416001)(19625215002)(4001350100001)(64706001)(5001860100001)(5002640100001)(5008740100001)(16236675004)(99286002)(54356999)(92566002)(40100003)(50986999)(36756003)(2501003)(76176999)(87936001)(5001830100001)(122556002)(19617315012)(77156002)(5007970100001)(19580395003)(83506001)(86362001)(82746002)(10090500001)(68736005)(102836002)(77096005)(19580405001)(4001540100001)(107886002)(106356001)(66066001)(5001960100002)(2900100001)(15975445007)(11100500001)(5004730100002)(2950100001)(189998001)(83716003)(105586002)(10400500002)(62966003)(7059030)(104396002);DIR:OUT;SFP:1101;SCL:1;SRVR:BY2PR02MB1701;H:BY2PR02MB1702.namprd02.prod.outlook.com;FPR:;SPF:None;PTR:InfoNoRecords;MX:1;A:1;LANG:en; received-spf: None (protection.outlook.com: adobe.com does not designate permitted sender hosts) spamdiagnosticoutput: 1:23 spamdiagnosticmetadata: NSPM Content-Type: multipart/alternative; boundary="_000_8BBC227A682B47C38771D10100A029E9adobecom_" MIME-Version: 1.0 X-OriginatorOrg: adobe.com X-MS-Exchange-CrossTenant-originalarrivaltime: 02 Oct 2015 11:23:44.8677 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: fa7b1b5a-7b34-4387-94ae-d2c178decee1 X-MS-Exchange-Transport-CrossTenantHeadersStamped: BY2PR02MB1701 --_000_8BBC227A682B47C38771D10100A029E9adobecom_ Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 SGF2ZSB5b3Ugc2VlbiB3aW5kb3cgZnVuY3Rpb25zPw0KaHR0cHM6Ly9kYXRhYnJpY2tzLmNvbS9i bG9nLzIwMTUvMDcvMTUvaW50cm9kdWNpbmctd2luZG93LWZ1bmN0aW9ucy1pbi1zcGFyay1zcWwu aHRtbA0KDQpGcm9tOiAiU2FpZi5BLkVsbGFmaUB3ZWxsc2ZhcmdvLmNvbTxtYWlsdG86U2FpZi5B LkVsbGFmaUB3ZWxsc2ZhcmdvLmNvbT4iDQpEYXRlOiBUaHVyc2RheSwgT2N0b2JlciAxLCAyMDE1 IGF0IDk6NDQgUE0NClRvOiAidXNlckBzcGFyay5hcGFjaGUub3JnPG1haWx0bzp1c2VyQHNwYXJr LmFwYWNoZS5vcmc+Ig0KU3ViamVjdDogQWNjdW11bGF0b3Igb2Ygcm93cz8NCg0KSGkgYWxsLA0K DQpJIG5lZWQgdG8gcmVwZWF0IGEgY291cGxlIHJvd3MgZnJvbSBhIGRhdGFmcmFtZSBieSBuIHRp bWVzIGVhY2guIFRvIGRvIHNvLCBJIHBsYW4gdG8gY3JlYXRlIGEgbmV3IERhdGEgRnJhbWUsIGJ1 dCBJIGFtIGJlaW5nIHVuYWJsZSB0byBmaW5kIGEgd2F5IHRvIGFjY3VtdWxhdGUg4oCcUm93c+KA nSBzb21ld2hlcmUsIGFzIHRoaXMgbWlnaHQgZ2V0IGh1Z2UsIEkgY2Fu4oCZdCBhY2N1bXVsYXRl IGludG8gYSBtdXRhYmxlIEFycmF5LCBJIHRoaW5rPy4NCg0KVGhhbmtzLA0KU2FpZg0KDQo= --_000_8BBC227A682B47C38771D10100A029E9adobecom_ Content-Type: text/html; charset="utf-8" Content-ID: <93530758A24645419BF19DABB1CC22E9@namprd02.prod.outlook.com> Content-Transfer-Encoding: base64 PGh0bWw+DQo8aGVhZD4NCjxtZXRhIGh0dHAtZXF1aXY9IkNvbnRlbnQtVHlwZSIgY29udGVudD0i dGV4dC9odG1sOyBjaGFyc2V0PXV0Zi04Ij4NCjwvaGVhZD4NCjxib2R5IHN0eWxlPSJ3b3JkLXdy YXA6IGJyZWFrLXdvcmQ7IC13ZWJraXQtbmJzcC1tb2RlOiBzcGFjZTsgLXdlYmtpdC1saW5lLWJy ZWFrOiBhZnRlci13aGl0ZS1zcGFjZTsgY29sb3I6IHJnYigwLCAwLCAwKTsgZm9udC1zaXplOiAx NHB4OyBmb250LWZhbWlseTogQ2FsaWJyaSwgc2Fucy1zZXJpZjsiPg0KPGRpdj4NCjxkaXY+DQo8 ZGl2PkhhdmUgeW91IHNlZW4gd2luZG93IGZ1bmN0aW9ucz88L2Rpdj4NCjxkaXY+PGEgaHJlZj0i aHR0cHM6Ly9kYXRhYnJpY2tzLmNvbS9ibG9nLzIwMTUvMDcvMTUvaW50cm9kdWNpbmctd2luZG93 LWZ1bmN0aW9ucy1pbi1zcGFyay1zcWwuaHRtbCI+aHR0cHM6Ly9kYXRhYnJpY2tzLmNvbS9ibG9n LzIwMTUvMDcvMTUvaW50cm9kdWNpbmctd2luZG93LWZ1bmN0aW9ucy1pbi1zcGFyay1zcWwuaHRt bDwvYT48L2Rpdj4NCjxkaXY+DQo8ZGl2IGlkPSJNQUNfT1VUTE9PS19TSUdOQVRVUkUiPjwvZGl2 Pg0KPC9kaXY+DQo8L2Rpdj4NCjwvZGl2Pg0KPGRpdj48YnI+DQo8L2Rpdj4NCjxzcGFuIGlkPSJP TEtfU1JDX0JPRFlfU0VDVElPTiI+DQo8ZGl2IHN0eWxlPSJmb250LWZhbWlseTpDYWxpYnJpOyBm b250LXNpemU6MTJwdDsgdGV4dC1hbGlnbjpsZWZ0OyBjb2xvcjpibGFjazsgQk9SREVSLUJPVFRP TTogbWVkaXVtIG5vbmU7IEJPUkRFUi1MRUZUOiBtZWRpdW0gbm9uZTsgUEFERElORy1CT1RUT006 IDBpbjsgUEFERElORy1MRUZUOiAwaW47IFBBRERJTkctUklHSFQ6IDBpbjsgQk9SREVSLVRPUDog I2I1YzRkZiAxcHQgc29saWQ7IEJPUkRFUi1SSUdIVDogbWVkaXVtIG5vbmU7IFBBRERJTkctVE9Q OiAzcHQiPg0KPHNwYW4gc3R5bGU9ImZvbnQtd2VpZ2h0OmJvbGQiPkZyb206IDwvc3Bhbj4mcXVv dDs8YSBocmVmPSJtYWlsdG86U2FpZi5BLkVsbGFmaUB3ZWxsc2ZhcmdvLmNvbSI+U2FpZi5BLkVs bGFmaUB3ZWxsc2ZhcmdvLmNvbTwvYT4mcXVvdDs8YnI+DQo8c3BhbiBzdHlsZT0iZm9udC13ZWln aHQ6Ym9sZCI+RGF0ZTogPC9zcGFuPlRodXJzZGF5LCBPY3RvYmVyIDEsIDIwMTUgYXQgOTo0NCBQ TTxicj4NCjxzcGFuIHN0eWxlPSJmb250LXdlaWdodDpib2xkIj5UbzogPC9zcGFuPiZxdW90Ozxh IGhyZWY9Im1haWx0bzp1c2VyQHNwYXJrLmFwYWNoZS5vcmciPnVzZXJAc3BhcmsuYXBhY2hlLm9y ZzwvYT4mcXVvdDs8YnI+DQo8c3BhbiBzdHlsZT0iZm9udC13ZWlnaHQ6Ym9sZCI+U3ViamVjdDog PC9zcGFuPkFjY3VtdWxhdG9yIG9mIHJvd3M/PGJyPg0KPC9kaXY+DQo8ZGl2Pjxicj4NCjwvZGl2 Pg0KPGRpdj4NCjxtZXRhIG5hbWU9IkdlbmVyYXRvciIgY29udGVudD0iTWljcm9zb2Z0IEV4Y2hh bmdlIFNlcnZlciI+DQo8IS0tIGNvbnZlcnRlZCBmcm9tIHJ0ZiAtLT48c3R5bGU+PCEtLSAuRW1h aWxRdW90ZSB7IG1hcmdpbi1sZWZ0OiAxcHQ7IHBhZGRpbmctbGVmdDogNHB0OyBib3JkZXItbGVm dDogIzgwMDAwMCAycHggc29saWQ7IH0gLS0+PC9zdHlsZT4NCjxkaXY+PGZvbnQgZmFjZT0iQ2Fs aWJyaSIgc2l6ZT0iMiI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZToxMXB0OyI+DQo8ZGl2PkhpIGFs bCw8L2Rpdj4NCjxkaXY+Jm5ic3A7PC9kaXY+DQo8ZGl2PkkgbmVlZCB0byByZXBlYXQgYSBjb3Vw bGUgcm93cyBmcm9tIGEgZGF0YWZyYW1lIGJ5IG4gdGltZXMgZWFjaC4gVG8gZG8gc28sIEkgcGxh biB0byBjcmVhdGUgYSBuZXcgRGF0YSBGcmFtZSwgYnV0IEkgYW0gYmVpbmcgdW5hYmxlIHRvIGZp bmQgYSB3YXkgdG8gYWNjdW11bGF0ZSDigJxSb3dz4oCdIHNvbWV3aGVyZSwgYXMgdGhpcyBtaWdo dCBnZXQgaHVnZSwgSSBjYW7igJl0IGFjY3VtdWxhdGUgaW50byBhIG11dGFibGUgQXJyYXksIEkg dGhpbms/LjwvZGl2Pg0KPGRpdj4mbmJzcDs8L2Rpdj4NCjxkaXY+VGhhbmtzLDwvZGl2Pg0KPGRp dj5TYWlmPC9kaXY+DQo8ZGl2PiZuYnNwOzwvZGl2Pg0KPC9zcGFuPjwvZm9udD48L2Rpdj4NCjwv ZGl2Pg0KPC9zcGFuPg0KPC9ib2R5Pg0KPC9odG1sPg0K --_000_8BBC227A682B47C38771D10100A029E9adobecom_--