Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4848810E7D for ; Sat, 27 Apr 2013 03:25:25 +0000 (UTC) Received: (qmail 33204 invoked by uid 500); 27 Apr 2013 03:25:20 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 33092 invoked by uid 500); 27 Apr 2013 03:25:20 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 33081 invoked by uid 99); 27 Apr 2013 03:25:20 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 27 Apr 2013 03:25:20 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of rkevinburton@charter.net designates 216.33.127.83 as permitted sender) Received: from [216.33.127.83] (HELO mta41.charter.net) (216.33.127.83) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 27 Apr 2013 03:25:13 +0000 Received: from imp09 ([10.20.200.9]) by mta41.charter.net (InterMail vM.8.01.05.02 201-2260-151-103-20110920) with ESMTP id <20130427032451.ULSV10143.mta41.charter.net@imp09>; Fri, 26 Apr 2013 23:24:51 -0400 Received: from [192.168.0.6] ([24.159.241.210]) by imp09 with smtp.charter.net id UrQq1l00P4Z4VX405rQrFa; Fri, 26 Apr 2013 23:24:51 -0400 X-Authority-Analysis: v=2.0 cv=Cp/n6QED c=1 sm=1 a=rvDZ1Ou6zk5jcJFOa7NSqA==:17 a=yUnIBFQkZM0A:10 a=hOpmn2quAAAA:8 a=lb7Xh8rC7tgA:10 a=fE3eKMaoAAAA:8 a=-Y-st3RlvMlXX_9Jfu0A:9 a=CjuIK1q_8ugA:10 a=5yKvCNww8xcA:10 a=hUswqBWy9Q8A:10 a=mV9VRH-2AAAA:8 a=zaHepHhhAAAA:8 a=MokV_7NViU0NbDMQdz4A:9 a=QEXdDO2ut3YA:10 a=_W_S_7VecoQA:10 a=tXsnliwV7b4A:10 a=SQ_PktkZ81UA:10 a=TZ1lnmcgI1mFgub1:21 a=rvDZ1Ou6zk5jcJFOa7NSqA==:117 X-Auth-id: cmtldmluYnVydG9uQGNoYXJ0ZXIubmV0 References: In-Reply-To: Mime-Version: 1.0 (1.0) Content-Transfer-Encoding: 7bit Content-Type: multipart/alternative; boundary=Apple-Mail-6E835C48-6546-4760-9A36-7006DE35A56D Message-Id: <131B8C5C-1E0E-4971-AD40-A696645FC8CB@charter.net> Cc: "user@hadoop.apache.org" X-Mailer: iPhone Mail (10B329) From: Kevin Burton Subject: Re: Warnings? Date: Fri, 26 Apr 2013 22:24:51 -0500 To: "user@hadoop.apache.org" X-Virus-Checked: Checked by ClamAV on apache.org --Apple-Mail-6E835C48-6546-4760-9A36-7006DE35A56D Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Is the native library not available for Ubuntu? If so how do I load it? Can I tell which key is off? Since I am just starting I would want to be as u= p to date as possible. It is out of date probably because I copied my exampl= es from books and tutorials. The main class does derive from Tool. Should I ignore this warning as it see= ms to be in error? Thank you. On Apr 26, 2013, at 7:49 PM, Ted Xu wrote: > Hi, >=20 > First warning is saying hadoop cannot load native library, usually a compr= ession codec. In that case, hadoop will use java implementation instead, whi= ch is slower. >=20 > Second is caused by hadoop 1.x/2.x configuration key change. You're using a= 1.x style key under 2.x, yet hadoop still guarantees backward compatibility= . >=20 > Third is saying that the main class of a hadoop application is recommanded= to implement org.apache.hadoop.util.Tool, or else generic command line opti= ons (e.g., -D options) will not supported. =20 >=20 >=20 > On Sat, Apr 27, 2013 at 5:51 AM, wrote: >> I am running a simple WordCount m/r job and I get output but I get five w= arnings that I am not sure if I should pay attention to: >>=20 >> 13/04/26 16:24:50 WARN util.NativeCodeLoader: Unable to load native-hadoo= p library for your platform... using builtin-java classes where applicable >>=20 >> 13/04/26 16:24:50 WARN conf.Configuration: session.id is deprecated. Inst= ead, use dfs.metrics.session-id >>=20 >> 13/04/26 16:24:50 WARN mapred.JobClient: Use GenericOptionsParser for par= sing the arguments. Applications should implement Tool for the same. >>=20 >> 13/04/26 16:24:51 WARN mapreduce.Counters: Group org.apache.hadoop.mapred= .Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter ins= tead >>=20 >> 13/04/26 16:24:51 WARN mapreduce.Counters: Counter name MAP_INPUT_BYTES i= s deprecated. Use FileInputFormatCounters as group name and BYTES_READ as c= ounter name instead >>=20 >> Any ideas on what these mean? The only one that I can see in the code is t= he third one. I am using GenericOptionsParser as it is part of an example th= at I copied. But I don't know why this is considered bad. >>=20 >> Thank you. >=20 >=20 >=20 > --=20 > Regards, > Ted Xu --Apple-Mail-6E835C48-6546-4760-9A36-7006DE35A56D Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 7bit
Is the native library not available for Ubuntu? If so how do I load it?

Can I tell which key is off? Since I am just starting I would want to be as up to date as possible. It is out of date probably because I copied my examples from books and tutorials.

The main class does derive from Tool. Should I ignore this warning as it seems to be in error?

Thank you.

On Apr 26, 2013, at 7:49 PM, Ted Xu <txu@gopivotal.com> wrote:

Hi,

First warning is saying hadoop cannot load native library, usually a compression codec. In that case, hadoop will use java implementation instead, which is slower.

Second is caused by hadoop 1.x/2.x configuration key change. You're using a 1.x style key under 2.x, yet hadoop still guarantees backward compatibility.

Third is saying that the main class of a hadoop application is recommanded to implement org.apache.hadoop.util.Tool, or else generic command line options (e.g., -D options) will not supported.   


On Sat, Apr 27, 2013 at 5:51 AM, <rkevinburton@charter.net> wrote:
I am running a simple WordCount m/r job and I get output but I get five warnings that I am not sure if I should pay attention to:

13/04/26 16:24:50 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

13/04/26 16:24:50 WARN conf.Configuration: session.id is deprecated. Instead, use dfs.metrics.session-id

13/04/26 16:24:50 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.

13/04/26 16:24:51 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead

13/04/26 16:24:51 WARN mapreduce.Counters: Counter name MAP_INPUT_BYTES is deprecated. Use FileInputFormatCounters as group name and  BYTES_READ as counter name instead

Any ideas on what these mean? The only one that I can see in the code is the third one. I am using GenericOptionsParser as it is part of an example that I copied. But I don't know why this is considered bad.

Thank you.




--
Regards,
Ted Xu
--Apple-Mail-6E835C48-6546-4760-9A36-7006DE35A56D--