Return-Path: Delivered-To: apmail-hadoop-core-user-archive@www.apache.org Received: (qmail 73963 invoked from network); 11 Nov 2008 18:57:26 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 11 Nov 2008 18:57:26 -0000 Received: (qmail 83591 invoked by uid 500); 11 Nov 2008 18:57:27 -0000 Delivered-To: apmail-hadoop-core-user-archive@hadoop.apache.org Received: (qmail 83557 invoked by uid 500); 11 Nov 2008 18:57:27 -0000 Mailing-List: contact core-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-user@hadoop.apache.org Delivered-To: mailing list core-user@hadoop.apache.org Received: (qmail 83546 invoked by uid 99); 11 Nov 2008 18:57:27 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 11 Nov 2008 10:57:27 -0800 X-ASF-Spam-Status: No, hits=2.0 required=10.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of tarandeep@gmail.com designates 209.85.134.190 as permitted sender) Received: from [209.85.134.190] (HELO mu-out-0910.google.com) (209.85.134.190) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 11 Nov 2008 18:56:09 +0000 Received: by mu-out-0910.google.com with SMTP id w1so24883mue.9 for ; Tue, 11 Nov 2008 10:56:42 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:mime-version:content-type; bh=xsBktE8jGxw3p11yXmYxOSdNc3lVHO6VK85iwOYM2fg=; b=r3BfQYgZG2r1tVFPhfKe1jIJ8Bq5rrDiFbZEQPCMBciG5rSD/5OKl5L51uE6oHa5Ax aUlAYwnLwfv0Rh2X7azIzW7I/BGjzv8hgqjJfCKTvRrDuwHhX7OOxASCgdN44vUn2EvT GthFBSmVshW2U/9o+y+jEyXMKTBPibiCQ4AXw= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:mime-version:content-type; b=soeeLv4gN8zw80sv51KO/cV7d8PfOYGO47NKQc1RuG2pRvqYWN+ZoDDqPGZIAf1FMJ Ky997aUJWX5mY0ewjHbdp02GUA3OdR4rwtLLUVzAyShYYdi/u3ZCwnN/0DVOV/qEbBED JF5dUzogccwdbPMiREsUqVezplmBiOBOrTQRs= Received: by 10.181.149.7 with SMTP id b7mr2589106bko.210.1226429801783; Tue, 11 Nov 2008 10:56:41 -0800 (PST) Received: by 10.181.30.1 with HTTP; Tue, 11 Nov 2008 10:56:41 -0800 (PST) Message-ID: Date: Tue, 11 Nov 2008 10:56:41 -0800 From: "Tarandeep Singh" To: core-user@hadoop.apache.org Subject: Caching data selectively on slaves MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_137885_31373938.1226429801776" X-Virus-Checked: Checked by ClamAV on apache.org ------=_Part_137885_31373938.1226429801776 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline Hi, Is is possible to cache data selectively on slave machines? Lets say I have data partitioned as D1, D2... and so on. D1 is required by Reducer R1, D2 by R2 and so on. I know this before hand because HashPartitioner.getPartition was used to partition the data. If I put D1, D2.. in distributed cache, then the data is copied on all machines. Is is possible to cache data selectively on machines? Thanks, Taran ------=_Part_137885_31373938.1226429801776--