Return-Path: Delivered-To: apmail-lucene-hadoop-user-archive@locus.apache.org Received: (qmail 11774 invoked from network); 16 Jul 2007 18:28:11 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 16 Jul 2007 18:28:11 -0000 Received: (qmail 12730 invoked by uid 500); 16 Jul 2007 18:28:13 -0000 Delivered-To: apmail-lucene-hadoop-user-archive@lucene.apache.org Received: (qmail 12302 invoked by uid 500); 16 Jul 2007 18:28:12 -0000 Mailing-List: contact hadoop-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hadoop-user@lucene.apache.org Delivered-To: mailing list hadoop-user@lucene.apache.org Received: (qmail 12288 invoked by uid 99); 16 Jul 2007 18:28:12 -0000 Received: from herse.apache.org (HELO herse.apache.org) (140.211.11.133) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 16 Jul 2007 11:28:12 -0700 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests= X-Spam-Check-By: apache.org Received-SPF: neutral (herse.apache.org: local policy) Received: from [207.126.228.149] (HELO rsmtp1.corp.yahoo.com) (207.126.228.149) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 16 Jul 2007 11:28:09 -0700 Received: from KEPTSHOULDLX (keptshould-lx.corp.yahoo.com [10.72.114.54]) (authenticated bits=0) by rsmtp1.corp.yahoo.com (8.13.8/8.13.6/y.rout) with ESMTP id l6GIRdcu090141 (version=TLSv1/SSLv3 cipher=RC4-MD5 bits=128 verify=NO) for ; Mon, 16 Jul 2007 11:27:39 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; s=serpent; d=yahoo-inc.com; c=nofws; q=dns; h=from:to:references:subject:date:message-id:mime-version: content-type:content-transfer-encoding:x-mailer:thread-index:in-reply-to:x-mimeole; b=dOigB78i+iXU6pXNUzl6pmgB0Xp/UDf6Rn/hQ+Ca2Yg94aZmN9ByYKVf/dY4+5UP From: "Hairong Kuang" To: References: Subject: RE: [URGENT] Help with using extra information while processing input data using map technique Date: Mon, 16 Jul 2007 11:27:39 -0700 Message-ID: <005d01c7c7d6$fde572b0$3672480a@ds.corp.yahoo.com> MIME-Version: 1.0 Content-Type: text/plain; charset="US-ASCII" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Office Outlook 11 Thread-Index: AcfHyEndeMrxlIClQPOkz2vH2rte6wADiELw In-Reply-To: X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.3028 X-Virus-Checked: Checked by ClamAV on apache.org MapReducerBase has a method configure(JobConf jobconf). You might use the method to initialize the extra information that your map needs. Hairong -----Original Message----- From: Pallavi P [mailto:pallavi.p@gmail.com] Sent: Monday, July 16, 2007 6:08 AM To: hadoop-user@lucene.apache.org Subject: [URGENT] Help with using extra information while processing input data using map technique Hi All, I am new to hadoop and learning how to use it. I have a problem which can be solvable using map-reduce technique. But, in my map step, I need to consider some extra information which depends on the input key,value pair. Can some one please help me what is the good way of taking this data? I am thinking of storing it in some HDFS and map code try to load it whenever it is processing a particular key, value pair. any other better approaches, please let me know. Thanks & Regards Pallavi