hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Krishna Kumar <kku...@nanigans.com>
Subject Re: Counters in MapReduce
Date Mon, 09 Jun 2014 11:07:59 GMT
You should use FileStatus to  decide what files you want to include in the InputPath, and use
the FileSystem class to delete or process the intermediate / final paths. Moving each job
in your iteration logic into different methods would help keep things simple.



From: unmesha sreeveni <unmeshabiju@gmail.com<mailto:unmeshabiju@gmail.com>>
Reply-To: "user@hadoop.apache.org<mailto:user@hadoop.apache.org>" <user@hadoop.apache.org<mailto:user@hadoop.apache.org>>
Date: Monday, June 9, 2014 at 6:02 AM
To: User Hadoop <user@hadoop.apache.org<mailto:user@hadoop.apache.org>>
Subject: Re: Counters in MapReduce

Ok I will check out with counters.
And after I st iteration the input file to job1 will be the output file of job 3.How to give
that.
Inorder to satisfy 2 conditions
First iteration : users input file
after first iteration :job 3 's output file as job 1 s input.



--
Thanks & Regards

Unmesha Sreeveni U.B
Hadoop, Bigdata Developer
Center for Cyber Security | Amrita Vishwa Vidyapeetham
http://www.unmeshasreeveni.blogspot.in/



________________________________
Kai Voigt Am Germaniahafen 1 k@123.org<mailto:k@123.org>
24143 Kiel +49 160 96683050
Germany @KaiVoigt




--
Thanks & Regards

Unmesha Sreeveni U.B
Hadoop, Bigdata Developer
Center for Cyber Security | Amrita Vishwa Vidyapeetham
http://www.unmeshasreeveni.blogspot.in/



Mime
View raw message