Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of maha@umail.ucsb.edu designates
 128.111.151.61 as permitted sender)
From: maha <maha@umail.ucsb.edu>
Mime-Version: 1.0 (Apple Message framework v1082)
Content-Type: multipart/alternative; boundary=Apple-Mail-4-784597940
Subject: Re: Needs a simple answer
Date: Fri, 17 Dec 2010 14:20:10 -0800
In-Reply-To: <AANLkTikO_x6kORT+dfJeQ3jHNB_vov5435vrsufs4Wa5@mail.gmail.com>
To: common-user@hadoop.apache.org
References: <525DA3F7-4ADC-4726-B721-A29623093CC4@umail.ucsb.edu>
 <AANLkTikO_x6kORT+dfJeQ3jHNB_vov5435vrsufs4Wa5@mail.gmail.com>
Message-Id: <F1E603AE-B1DF-40F8-B474-992C8403A42F@umail.ucsb.edu>

--Apple-Mail-4-784597940
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
	charset=us-ascii

Hi Ted, thanks for the hint , but I'm using only one machine now .. so =
the file is definitely in there.=20

So, How can I open an hdfs- file in my InputFormat class (in GetSplits) =
so I can pass the contents to the mappers ?

Now, the splits are splits of files-paths from the input directory ( eg. =
split1: /tmp/f1, split2:/tmp/f2 .... split4: /tmp/f4)  instead I want =
----->  ( split1: content of file1 , ....).

Thank you,

Maha


On Dec 16, 2010, at 2:49 PM, Ted Dunning wrote:

> Maha,
>=20
> Remember that the mapper is not running on the same machine as the =
main
> class.  Thus local files aren't where you think.
>=20
> On Thu, Dec 16, 2010 at 1:06 PM, maha <maha@umail.ucsb.edu> wrote:
>=20
>> Hi all,
>>=20
>>  Why the following lines would work in the main class (WordCount) and =
not
>> in Mapper ? even though " myconf " is set in WordCount to point to =
the
>> getConf() returned object.
>>=20
>>            try{
>>                   FileSystem hdfs =3D =
FileSystem.get(wc.WordCount.myconf);
>>                   hdfs.copyFromLocalFile(new Path("/Users/file"), new
>> Path("/tmp/file"));
>>                  }catch(Exception e) { System.err.print("\nError");}
>>=20
>>=20
>> Also, the print statement will never print on console unless it's in =
my
>> run function..
>>=20
>>     Appreciate it :)
>>=20
>>       Maha
>>=20
>>=20


--Apple-Mail-4-784597940--