hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Oleg Zhurakousky <oleg.zhurakou...@gmail.com>
Subject Re: hadoop yarn
Date Thu, 22 Jan 2015 22:30:53 GMT
To benefit from YARN I'd suggest to use Apache Tez (application framework
that sits on top of YARN) - http://tez.apache.org/
Then you can see a big difference in how WordCount and other type jobs
could be simplified.
https://github.com/apache/tez/blob/master/tez-examples/src/main/java/org/apache/tez/examples/WordCount.java

On Tue, Jan 20, 2015 at 2:21 AM, Drake민영근 <drake.min@nexr.com> wrote:

> Hi siva,
>
> MR program is almost same for both MR1 or MR2. Just another framework
> needed to run the program. If your previous program was written with new
> API(org.apache.hadoop.mapreduce packages), just re-complie with hadoop 2
> libs. Maybe some errors/depricated methods are popped up, but not critical.
>
> Wish your luck.
>
> Thanks.
> Drake Min
>
> Drake 민영근 Ph.D
>
> On Tue, Jan 20, 2015 at 4:09 PM, siva kumar <siva165755@gmail.com> wrote:
>
>> Thanks Rohit. Do we have any examples on MR2 other than wordcount, bcoz i
>> dnt find much difference for word count example for both MR1 and MR2. Im
>> new to yarn, so if you suggest me any example programs on MR2 it could help
>> me out in a better way.
>>
>> Thanks and regards,
>> siva
>> On Tue, Jan 20, 2015 at 11:45 AM, Rohith Sharma K S <
>> rohithsharmaks@huawei.com> wrote:
>>
>>>  Refer below link,
>>>
>>>
>>> http://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/WritingYarnApplications.html
>>>
>>>
>>>
>>> Thanks & Regards
>>>
>>> Rohith  Sharma K S
>>>
>>>
>>>
>>> *From:* siva kumar [mailto:siva165755@gmail.com]
>>> *Sent:* 20 January 2015 11:24
>>> *To:* user@hadoop.apache.org
>>> *Subject:* hadoop yarn
>>>
>>>
>>>
>>> Hi All,
>>>
>>>            Can anyone suggest me few links for writing  MR2 program on
>>> Yarn ?
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> Thanks and regrads,
>>>
>>> siva
>>>
>>
>>
>

Mime
View raw message