Return-Path: X-Original-To: apmail-spark-dev-archive@minotaur.apache.org Delivered-To: apmail-spark-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C820E116EC for ; Thu, 4 Sep 2014 06:35:53 +0000 (UTC) Received: (qmail 6441 invoked by uid 500); 4 Sep 2014 06:35:02 -0000 Delivered-To: apmail-spark-dev-archive@spark.apache.org Received: (qmail 6255 invoked by uid 500); 4 Sep 2014 06:35:02 -0000 Mailing-List: contact dev-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list dev@spark.apache.org Received: (qmail 4533 invoked by uid 99); 4 Sep 2014 06:34:36 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 04 Sep 2014 06:34:36 +0000 X-ASF-Spam-Status: No, hits=-2.8 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_HI,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of raymond.liu@intel.com designates 192.55.52.88 as permitted sender) Received: from [192.55.52.88] (HELO mga01.intel.com) (192.55.52.88) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 04 Sep 2014 06:34:31 +0000 Received: from fmsmga001.fm.intel.com ([10.253.24.23]) by fmsmga101.fm.intel.com with ESMTP; 03 Sep 2014 23:34:10 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.04,464,1406617200"; d="scan'208,217";a="586063711" Received: from fmsmsx107.amr.corp.intel.com ([10.18.124.205]) by fmsmga001.fm.intel.com with ESMTP; 03 Sep 2014 23:32:57 -0700 Received: from fmsmsx111.amr.corp.intel.com (10.18.116.5) by fmsmsx107.amr.corp.intel.com (10.18.124.205) with Microsoft SMTP Server (TLS) id 14.3.195.1; Wed, 3 Sep 2014 23:32:57 -0700 Received: from shsmsx151.ccr.corp.intel.com (10.239.6.50) by fmsmsx111.amr.corp.intel.com (10.18.116.5) with Microsoft SMTP Server (TLS) id 14.3.195.1; Wed, 3 Sep 2014 23:32:57 -0700 Received: from shsmsx101.ccr.corp.intel.com ([169.254.1.198]) by SHSMSX151.ccr.corp.intel.com ([169.254.3.174]) with mapi id 14.03.0195.001; Thu, 4 Sep 2014 14:32:55 +0800 From: "Liu, Raymond" To: =?utf-8?B?54mb5YWG5o23?= , Patrick Wendell CC: "user@spark.apache.org" , "dev@spark.apache.org" Subject: RE: memory size for caching RDD Thread-Topic: memory size for caching RDD Thread-Index: AQHPyAl63cXsncrreUCDCuauIY9xyJvwgwzA Date: Thu, 4 Sep 2014 06:32:55 +0000 Message-ID: <391D65D0EBFC9B4B95E117F72A360F1A0E9AE375@SHSMSX101.ccr.corp.intel.com> References: In-Reply-To: Accept-Language: zh-CN, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.239.127.40] Content-Type: multipart/alternative; boundary="_000_391D65D0EBFC9B4B95E117F72A360F1A0E9AE375SHSMSX101ccrcor_" MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org --_000_391D65D0EBFC9B4B95E117F72A360F1A0E9AE375SHSMSX101ccrcor_ Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 WW91IGRvbuKAmXQgbmVlZCB0by4gSXQgaXMgbm90IHN0YXRpYyBhbGxvY2F0ZWQgdG8gUkREIGNh Y2hlLCBpdCBpcyBqdXN0IGFuIHVwIGxpbWl0Lg0KSWYgeW91IGRvbuKAmXQgdXNlIHVwIHRoZSBt ZW1vcnkgYnkgUkREIGNhY2hlLCBpdCBpcyBhbHdheXMgYXZhaWxhYmxlIGZvciBvdGhlciB1c2Fn ZS4gZXhjZXB0IHRob3NlIG9uZSBhbHNvIGNvbnRyb2xsZWQgYnkgc29tZSBtZW1vcnlGcmFjdGlv biBjb25mLiBlLmcuIHNwYXJrLnNodWZmbGUubWVtb3J5RnJhY3Rpb24gd2hpY2ggeW91IGFsc28g c2V0IHRoZSB1cCBsaW1pdC4NCg0KQmVzdCBSZWdhcmRzLA0KUmF5bW9uZCBMaXUNCg0KRnJvbTog 54mb5YWG5o23IFttYWlsdG86bnpqZW1haWxAZ21haWwuY29tXQ0KU2VudDogVGh1cnNkYXksIFNl cHRlbWJlciAwNCwgMjAxNCAyOjI3IFBNDQpUbzogUGF0cmljayBXZW5kZWxsDQpDYzogdXNlckBz cGFyay5hcGFjaGUub3JnOyBkZXZAc3BhcmsuYXBhY2hlLm9yZw0KU3ViamVjdDogUmU6IG1lbW9y eSBzaXplIGZvciBjYWNoaW5nIFJERA0KDQpCdXQgaXMgaXQgcG9zc2libGUgdG8gbWFrZSB0IHJl c2l6YWJsZT8gV2hlbiB3ZSBkb24ndCBoYXZlIG1hbnkgUkREIHRvIGNhY2hlLCB3ZSBjYW4gZ2l2 ZSBzb21lIG1lbW9yeSB0byBvdGhlcnMuDQoNCjIwMTQtMDktMDQgMTM6NDUgR01UKzA4OjAwIFBh dHJpY2sgV2VuZGVsbCA8cHdlbmRlbGxAZ21haWwuY29tPG1haWx0bzpwd2VuZGVsbEBnbWFpbC5j b20+PjoNCkNoYW5naW5nIHRoaXMgaXMgbm90IHN1cHBvcnRlZCwgaXQgc2kgaW1tdXRhYmxlIHNp bWlsYXIgdG8gb3RoZXIgc3BhcmsNCmNvbmZpZ3VyYXRpb24gc2V0dGluZ3MuDQoNCk9uIFdlZCwg U2VwIDMsIDIwMTQgYXQgODoxMyBQTSwg54mb5YWG5o23IDxuemplbWFpbEBnbWFpbC5jb208bWFp bHRvOm56amVtYWlsQGdtYWlsLmNvbT4+IHdyb3RlOg0KPiBEZWFyIGFsbDoNCj4NCj4gU3Bhcmsg dXNlcyBtZW1vcnkgdG8gY2FjaGUgUkREIGFuZCB0aGUgbWVtb3J5IHNpemUgaXMgc3BlY2lmaWVk IGJ5DQo+ICJzcGFyay5zdG9yYWdlLm1lbW9yeUZyYWN0aW9uIi4NCj4NCj4gT25lIHRoZSBFeGVj dXRvciBzdGFydHMsIGRvZXMgU3Bhcmsgc3VwcG9ydCBhZGp1c3RpbmcvcmVzaXppbmcgbWVtb3J5 IHNpemUNCj4gb2YgdGhpcyBwYXJ0IGR5bmFtaWNhbGx5Pw0KPg0KPiBUaGFua3MuDQo+DQo+IC0t DQo+ICpSZWdhcmRzLCoNCj4gKlpoYW9qaWUqDQoNCg0KDQotLQ0KUmVnYXJkcywNClpoYW9qaWUN Cg0K --_000_391D65D0EBFC9B4B95E117F72A360F1A0E9AE375SHSMSX101ccrcor_--