Return-Path: Delivered-To: apmail-hadoop-core-user-archive@www.apache.org Received: (qmail 29982 invoked from network); 24 Jul 2008 15:04:22 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 24 Jul 2008 15:04:22 -0000 Received: (qmail 55039 invoked by uid 500); 24 Jul 2008 15:04:17 -0000 Delivered-To: apmail-hadoop-core-user-archive@hadoop.apache.org Received: (qmail 55000 invoked by uid 500); 24 Jul 2008 15:04:17 -0000 Mailing-List: contact core-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-user@hadoop.apache.org Delivered-To: mailing list core-user@hadoop.apache.org Received: (qmail 54989 invoked by uid 99); 24 Jul 2008 15:04:17 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 24 Jul 2008 08:04:17 -0700 X-ASF-Spam-Status: No, hits=2.8 required=10.0 tests=MIME_BASE64_BLANKS,MIME_BASE64_TEXT,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of guxiaobo1982@hotmail.com designates 65.55.111.103 as permitted sender) Received: from [65.55.111.103] (HELO blu0-omc2-s28.blu0.hotmail.com) (65.55.111.103) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 24 Jul 2008 15:03:20 +0000 Received: from BLU139-DS3 ([65.55.111.73]) by blu0-omc2-s28.blu0.hotmail.com with Microsoft SMTPSVC(6.0.3790.3959); Thu, 24 Jul 2008 08:03:24 -0700 X-Originating-IP: [116.76.138.8] X-Originating-Email: [guxiaobo1982@hotmail.com] Message-ID: From: "Amber" In-Reply-To: <7cfed280807231012s3eab3c90r59fcd1842f3b24dd@mail.gmail.com> To: References: <7cfed280807231012s3eab3c90r59fcd1842f3b24dd@mail.gmail.com> Subject: Re: Using MapReduce to do table comparing. Date: Thu, 24 Jul 2008 23:03:20 +0800 X-Unsent: 1 MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: base64 X-Priority: 3 X-MSMail-Priority: Normal Importance: Normal X-Mailer: Microsoft Windows Live Mail 12.0.1606 X-MimeOLE: Produced By Microsoft MimeOLE V12.0.1606 X-OriginalArrivalTime: 24 Jul 2008 15:03:24.0411 (UTC) FILETIME=[6B7E3CB0:01C8ED9E] X-Virus-Checked: Checked by ClamAV on apache.org WWVzLCBJIHRoaW5rIHRoaXMgaXMgdGhlIHNpbXBsZXN0IG1ldGhvZCAsIGJ1dCB0aGVyZSBhcmUg cHJvYmxlbXMgdG9vOg0KDQoxLiBUaGUgcmVkdWNlIHN0YWdlIHdvdWxkbid0IGJlZ2luIHVudGls IHRoZSBtYXAgc3RhZ2UgZW5kcywgYnkgd2hlbiB3ZSBoYXZlIGRvbmUgYSB0d28gdGFibGUgc2Nh bm5pbmcsIGFuZCB0aGUgY29tcGFyaW5nIHdpbGwgdGFrZSBhbG1vc3QgdGhlIHNhbWUgdGltZSwg YmVjYXVzZSBhYm91dCA5MCUgb2YgaW50ZXJtZWRpYXRlIDxrZXksIHZhbHVlPiBwYWlycyB3aWxs IGhhdmUgdHdvIHZhbHVlcyBhbmQgZGlmZmVyZW50IGtleXMsIGlmIEkgY2FuIHNwZWNpZnkgYSBu dW1iZXIgbiwgYnkgd2hlbiB0aGVyZSBhcmUgbiBpbnRlcm1lZGlhdGUgcGFpcnMgd2l0aCB0aGUg c2FtZSBrZXkgdGhlIHJlZHVjZSB0YXNrcyBzdGFydCwgdGhhdCB3aWxsIGJlIGJldHRlci4gSW4g bXkgY2FzZSBJIHdpbGwgc2V0IHRoZSBtYWdpYyBudW1iZXIgdG8gMi4NCg0KMi4gSSBhbSBub3Qg c3VyZSBhYm91dCBob3cgSGFkb29wIHN0b3JlcyBpbnRlcm1lZGlhdGUgPGtleSwgdmFsdWU+IHBh aXJzLCB3ZSB3b3VsZCBub3QgYWZmb3JkIGl0IGFzIGRhdGEgdm9sdW1lIGluY3JlYXNpbmcgaWYg aXQgaXMga2VwdCBpbiBtZW1vcnkuDQoNCi0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tDQpGcm9tOiAiSmFtZXMgTW9vcmUiIDxqYW1lc3RoZXBpcGVyQGdt YWlsLmNvbT4NClNlbnQ6IFRodXJzZGF5LCBKdWx5IDI0LCAyMDA4IDE6MTIgQU0NClRvOiA8Y29y ZS11c2VyQGhhZG9vcC5hcGFjaGUub3JnPg0KU3ViamVjdDogUmU6IFVzaW5nIE1hcFJlZHVjZSB0 byBkbyB0YWJsZSBjb21wYXJpbmcuDQoNCj4gT24gV2VkLCBKdWwgMjMsIDIwMDggYXQgNzozMyBB TSwgQW1iZXIgPGd1eGlhb2JvMTk4MkBob3RtYWlsLmNvbT4gd3JvdGU6DQo+PiBXZSBoYXZlIGEg MTAgbWlsbGlvbiByb3cgdGFibGUgZXhwb3J0ZWQgZnJvbSBBUzQwMCBtYWluZnJhbWUgZXZlcnkg ZGF5LCB0aGUgdGFibGUgaXMgZXhwb3J0ZWQgYXMgYSBjc3YgdGV4dCBmaWxlLCB3aGljaCBpcyBh Ym91dCAzMEdCIGluIHNpemUsIHRoZW4gdGhlIGNzdiBmaWxlIGlzIGltcG9ydGVkIGludG8gYSBS REJNUyB0YWJsZSB3aGljaCBpcyBkcm9wcGVkIGFuZCByZWNyZWF0ZWQgZXZlcnkgZGF5LiBOb3cg d2Ugd2FudCB0byBmaW5kIGhvdyBtYW55IHJvd3MgYXJlIHVwZGF0ZWQgZHVyaW5nIGVhY2ggZXhw b3J0LWltcG9ydCBpbnRlcnZhbCwgdGhlIHRhYmxlIGhhcyBhIHByaW1hcnkga2V5LCBzbyBkZWxl dGVzIGFuZCBpbnNlcnRzIGNhbiBiZSBmb3VuZCB1c2luZyBSREJNUyBqb2lucyBxdWlja2x5LCBi dXQgd2UgbXVzdCBkbyBhIGNvbHVtbiB0byBjb2x1bW4gY29tcGFyaW5nIGluIG9yZGVyIHRvIGZp bmQgdGhlIGRpZmZlcmVuY2UgYmV0d2VlbiByb3dzICggYWJvdXQgOTAlKSB3aXRoIHRoZSBzYW1l IHByaW1hcnkga2V5cy4gT3VyIGdvYWwgaXMgdG8gZmluZCBhIGNvbXBhcmluZyBwcm9jZXNzIHdo aWNoIHRha2VzIG5vIG1vcmUgdGhhbiAxMCBtaW51dGVzIHdpdGggYSA0LW5vZGUgY2x1c3Rlciwg ZWFjaCBzZXJ2ZXIgaW4gd2hpY2ggaGFzIDQgNC1jb3JlIDMuMCBHSHogQ1BVcywgOEdCIG1lbW9y eSAgYW5kIGEgIDMwMEcgbG9jYWwgIFJBSUQ1IGFycmF5Lg0KPj4NCj4+IEJlbGxvdyBpcyBvdXIg Y3VycmVudCBzb2x1dGlvbjoNCj4+ICAgIFRoZSBvbGQgZGF0YSBpcyBrZXB0IGluIHRoZSBSREJN UyB3aXRoIGluZGV4IGNyZWF0ZWQgb24gdGhlIHByaW1hcnkga2V5LCB0aGUgbmV3IGRhdGEgaXMg aW1wb3J0ZWQgaW50byBIREZTIGFzIHRoZSBpbnB1dCBmaWxlIG9mIG91ciBNYXAtUmVkdWNlIGpv Yi4gRXZlcnkgbWFwIHRhc2sgY29ubmVjdHMgdG8gdGhlIFJEQk1TIGRhdGFiYXNlLCBhbmQgc2Vs ZWN0cyBvbGQgZGF0YSBmcm9tIGl0IGZvciBldmVyeSByb3csIG1hcCB0YXNrcyB3aWxsIGdlbmVy YXRlIG91dHB1dHMgaWYgZGlmZmVyZW5jZXMgYXJlIGZvdW5kLCBhbmQgdGhlcmUgYXJlIG5vIHJl ZHVjZSB0YXNrcy4NCj4+DQo+PiBBcyB5b3UgY2FuIHNlZSwgd2l0aCB0aGUgbnVtYmVyIG9mIGNv bmN1cnJlbnQgbWFwIHRhc2tzIGluY3JlYXNpbmcsIHRoZSBSREJNUyBkYXRhYmFzZSB3aWxsIGJl Y29tZSB0aGUgYm90dGxlbmVjaywgc28gd2Ugd2FudCB0byBraWNrIG9mZiB0aGUgUkRCTVMsIGJ1 dCB3ZSBoYXZlIG5vIGlkZWEgYWJvdXQgaG93IHRvIHJldHJpZXZlIHRoZSBvbGQgcm93IHdpdGgg YSBnaXZlbiBrZXkgcXVpY2tseSBmcm9tIEhERlMgZmlsZXMsIGFueSBzdWdnZXN0aW9uIGlzIHdl bGNvbWUuDQo+IA0KPiBUaGluayBvZiBtYXAvcmVkdWNlIGFzIGdpdmluZyB5b3UgYSBraW5kIG9m IGtleS92YWx1ZSBsb29rdXAgZm9yIGZyZWUNCj4gLSBpdCBqdXN0IGZhbGxzIG91dCBvZiBob3cg dGhlIHN5c3RlbSB3b3Jrcy4NCj4gDQo+IFlvdSBkb24ndCBjYXJlIGFib3V0IHRoZSBSREJNUy4g IEl0J3MgYSBkaXN0cmFjdGlvbiAtIHlvdSdyZSBnaXZlbiBhDQo+IHNldCBvZiBjc3YgZmlsZXMg d2l0aCB1bmlxdWUga2V5cyBhbmQgZGF0ZXMsIGFuZCB5b3UgbmVlZCB0byBmaW5kIHRoZQ0KPiBk aWZmZXJlbmNlcyBiZXR3ZWVuIHRoZW0uDQo+IA0KPiBTYXkgdGhlIGRhdGEgbG9va3MgbGlrZSB0 aGlzOg0KPiANCj4gRmlsZSBmb3IganVsIDEwOg0KPiAweDEsc3R1ZmYNCj4gMHgyLG1vcmUgc3R1 ZmYNCj4gDQo+IEZpbGUgZm9yIGp1bCAxMToNCj4gMHgxLHN0dWZmDQo+IDB4MixhcHBsZXMNCj4g MHgzLHBhcnJvdA0KPiANCj4gUHJlcHJvY2VzcyB0aGUgY3N2IGZpbGVzIHRvIGFkZCBkYXRlcyB0 byB0aGUgdmFsdWVzOg0KPiANCj4gRmlsZSBmb3IganVsIDEwOg0KPiAweDEsMjAwODA3MTAsc3R1 ZmYNCj4gMHgyLDIwMDgwNzEwLG1vcmUgc3R1ZmYNCj4gDQo+IEZpbGUgZm9yIGp1bCAxMToNCj4g MHgxLDIwMDgwNzExLHN0dWZmDQo+IDB4MiwyMDA4MDcxMSxhcHBsZXMNCj4gMHgzLDIwMDgwNzEx LHBhcnJvdA0KPiANCj4gRmVlZCB0d28gZGF5cyB3b3J0aCBvZiB0aGVzZSBmaWxlcyBpbnRvIGEg aGFkb29wIGpvYi4NCj4gDQo+IFRoZSBtYXBwZXIgc3BsaXRzIHRoZXNlIGludG8gaz0weDEsIHY9 MjAwODA3MTAsc3R1ZmYgZXRjLg0KPiANCj4gVGhlIHJlZHVjZXIgZ2V0cyBvbmUgb3IgdHdvIHYn cyBwZXIga2V5LCBhbmQgZWFjaCB2IGhhcyB0aGUgZGF0ZQ0KPiBlbWJlZGRlZCBpbiBpdCAtIHRo YXQncyBlc3NlbnRpYWxseSB5b3VyIGxvb2t1cCBzdGVwLg0KPiANCj4gWW91J2xsIGVuZCB1cCB3 aXRoIGEgc3lzdGVtIHRoYXQgY2FuIGRvIGNvbXBhcmVzIGZvciBhbnkgdHdvIGRhdGVzLA0KPiBh bmQgY291bGQgZWFzaWx5IGJlIGV4cGFuZGVkIHRvIGRvIGFsbCBzb3J0cyBvZiBkZWx0YXMgYWNy b3NzIHRoZXNlDQo+IGZpbGVzLg0KPiANCj4gVGhlIHByZXByb2Nlc3MtdGhlLWZpbGVzLXRvLWFk ZC1hLWRhdGUgY2FuIHByb2JhYmx5IGJlIGluY2x1ZGVkIGFzDQo+IHBhcnQgb2YgeW91ciBtYXBw ZXIgYW5kIGlzbid0IHJlYWxseSBhIHNlcGFyYXRlIHN0ZXAgLSBqdXN0IGRlcGVuZHMgb24NCj4g aG93IGVhc3kgaXQgaXMgdG8gdXNlIG9uZSBvZiB0aGUgb2ZmLXRoZS1zaGVsZiBtYXBwZXJzIHdp dGggeW91ciBkYXRhLg0KPiBJZiBpdCB0dXJucyBvdXQgdG8gYmUgaXRzIG93biBzdGVwLCBpdCBj YW4gYmVjb21lIGEgdmVyeSBzaW1wbGUNCj4gaGFkb29wIGpvYi4NCj4gDQo+IC0tIA0KPiBKYW1l cyBNb29yZSB8IGphbWVzQHJlc3RwaG9uZS5jb20NCj4gUnVieSBhbmQgUnVieSBvbiBSYWlscyBj b25zdWx0aW5nDQo+IGJsb2cucmVzdHBob25lLmNvbQ0KPiA=