Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id F28611761D for ; Sun, 19 Apr 2015 07:30:53 +0000 (UTC) Received: (qmail 54012 invoked by uid 500); 19 Apr 2015 07:30:48 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 53906 invoked by uid 500); 19 Apr 2015 07:30:48 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 53896 invoked by uid 99); 19 Apr 2015 07:30:47 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 19 Apr 2015 07:30:47 +0000 X-ASF-Spam-Status: No, hits=3.2 required=5.0 tests=FORGED_YAHOO_RCVD,HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: message received from 54.191.145.13 which is an MX secondary for user@hadoop.apache.org) Received: from [54.191.145.13] (HELO mx1-us-west.apache.org) (54.191.145.13) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 19 Apr 2015 07:30:42 +0000 Received: from nm33-vm7.bullet.mail.bf1.yahoo.com (nm33-vm7.bullet.mail.bf1.yahoo.com [72.30.239.207]) by mx1-us-west.apache.org (ASF Mail Server at mx1-us-west.apache.org) with ESMTPS id 9DB1820BB7 for ; Sun, 19 Apr 2015 07:30:21 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1429428488; bh=zcO17kX5Gv6gAzhQBQ5/fNviqM8zkKL2kGd2Tg2yMZE=; h=Date:From:Reply-To:To:In-Reply-To:References:Subject:From:Subject; b=YB5hgvAmXbDQ1Z/Vpy4kjZn6mgsHluOaHy/p8ufcT/URyyx/cG9ntTciWk6ifJlIjMbWrGqP6jrkhAgp7Rzt8FuZag2+8Jx0eglIuAoimnyU1dJP3JpRA6jDfJG8YKibxiSHjaHg9VnejGVX2j+yuGAkwCY58AKhEzK5knxLQFyAKI5ZmgSxv4NAaXsge9hdWZjT6rR66TKTAw/WxY5+lK6ZHhO+xYXq2QHbemIlvM1zsyTqjNfaawGT6yUa5juJGQoiNMC11F9sk5F7b+t7vMqyPzA8Pc1huVnuQ+L0LglDxtQ8Vf9IccbGF5xcMcOftPzi4DPqcnFPKGXdtMCFAg== Received: from [66.196.81.172] by nm33.bullet.mail.bf1.yahoo.com with NNFMP; 19 Apr 2015 07:28:08 -0000 Received: from [98.139.212.238] by tm18.bullet.mail.bf1.yahoo.com with NNFMP; 19 Apr 2015 07:28:08 -0000 Received: from [127.0.0.1] by omp1047.mail.bf1.yahoo.com with NNFMP; 19 Apr 2015 07:28:08 -0000 X-Yahoo-Newman-Property: ymail-3 X-Yahoo-Newman-Id: 874926.26802.bm@omp1047.mail.bf1.yahoo.com X-YMail-OSG: uAslJhYVM1kv1giZsdEl5L1VIbnJfueR0SQuJTNzg6F.pRfKJfyi2391FdhFW6w BwsW4vmO50iG0MFIXu_xan82JC4wrMdVAixhs4_a05ihYy2VTGhDW7Hmdtg9M02Wj6RT9CWyUAeu wIZqzrll0oAmdjzbU86YPiDcRE2vQNV_12WFvLav101stHjOePIblJR6pdTxFmlJ00sYaxEt2fMH kE8EIDA3El4bbremfz90b9eL2_gpMqcWeH6aa1xaHXKh6mGeaUtEz8R9HrolGDlvmtxfWu9JbfDc r5szQY17STc89HtqZIN_81I3rEp_zzuvthnIk6G4ALdoX61WZYooEjQYxnL_1T9nRpy_wSopsrwm 45HLPOuuloy6dALrlfgUwX1F9UNvx2JfqU0hlfeWOIMhreDbV_FfxCxEMcAEhjtWTZBUQp3JGyNk WfPR3zVRaQftQwVoAWA5PJ4gPFeS0LZLkcF82wVH.mwtj3B5UBKUmTwYrfRD4.2wzHaMsIGxP.Wc hHfLImwlA Received: by 76.13.27.6; Sun, 19 Apr 2015 07:28:08 +0000 Date: Sun, 19 Apr 2015 07:28:07 +0000 (UTC) From: Mahmood Naderan Reply-To: Mahmood Naderan To: Chris Nauroth , User Message-ID: <1405975281.7180238.1429428487458.JavaMail.yahoo@mail.yahoo.com> In-Reply-To: References: Subject: Re: Again incompatibility, locating example jars MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_7180237_623078208.1429428487447" X-Virus-Checked: Checked by ClamAV on apache.org ------=_Part_7180237_623078208.1429428487447 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Thanks that fixed the error however, still it cannot be run like the previo= us version. The command istime ${HADOOP_HOME}/bin/hadoop jar=C2=A0 ${HADOOP_HOME}/share= /hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0.jar grep ${WORK_DIR}/data= -MicroBenchmarks/in ${WORK_DIR}/data-MicroBenchmarks/out/grep a*xyz where=C2=A0 ${WORK_DIR}=3D`pwd` Here is the output [mahmood@tiger MicroBenchmarks]$ pwd /home/mahmood/bigdatabench/BigDataBench_V3.1_Hadoop_Hive/MicroBenchmarks [mahmood@tiger MicroBenchmarks]$ hadoop fs -ls /home/mahmood/bigdatabench/B= igDataBench_V3.1_Hadoop_Hive/MicroBenchmarks/data-MicroBenchmarks/in/in 15/04/19 11:56:26 WARN util.NativeCodeLoader: Unable to load native-hadoop = library for your platform... using builtin-java classes where applicable Found 2 items -rw-r--r--=C2=A0=C2=A0 1 mahmood supergroup=C2=A0 524149543 2015-04-19 10:1= 9 /home/mahmood/bigdatabench/BigDataBench_V3.1_Hadoop_Hive/MicroBenchmarks/= data-MicroBenchmarks/in/in/lda_wiki1w_1 -rw-r--r--=C2=A0=C2=A0 1 mahmood supergroup=C2=A0 526316345 2015-04-19 10:1= 9 /home/mahmood/bigdatabench/BigDataBench_V3.1_Hadoop_Hive/MicroBenchmarks/= data-MicroBenchmarks/in/in/lda_wiki1w_2 .... 15/04/19 11:57:06 INFO mapred.MapTask: Starting flush of map output 15/04/19 11:57:06 INFO mapred.LocalJobRunner: map task executor complete. 15/04/19 11:57:06 WARN mapred.LocalJobRunner: job_local962861772_0001 java.lang.Exception: java.io.FileNotFoundException: Path is not a file: /ho= me/mahmood/bigdatabench/BigDataBench_V3.1_Hadoop_Hive/MicroBenchmarks/data-= MicroBenchmarks/in/in =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.hdfs.server= .namenode.INodeFile.valueOf(INodeFile.java:70) =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.hdfs.server= .namenode.INodeFile.valueOf(INodeFile.java:56) =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.hdfs.server= .namenode.FSNamesystem.getBlockLocationsUpdateTimes(FSNamesystem.java:1891) ... =C2=A0 As you can see, it says the path is not valid but the files are actually th= ere. Regards, Mahmood=20 On Sunday, April 19, 2015 10:47 AM, Chris Nauroth wrote: =20 Hello Mahmood, You want the hadoop-mapreduce-examples-2.6.0.jar file. =C2=A0The grep job (= as well as other example jobs like wordcount) reside in this jar file for t= he 2.x line of the codebase. Chris NaurothHortonworkshttp://hortonworks.com/ From: Mahmood Naderan Reply-To: User , Mahmood Naderan Date: Saturday, April 18, 2015 at 10:59 PM To: User Subject: Again incompatibility, locating example jars Hi,There is another incompatibility between 1.2.0 and 2.2.6. I appreciate i= s someone help to figure it out.This command works on 1.2.0 time ${HADOOP_HOME}/bin/hadoop jar=C2=A0 ${HADOOP_HOME}/hadoop-examples-*.j= ar grep ${WORK_DIR}/data-MicroBenchmarks/in ${WORK_DIR}/data-MicroBenchmark= s/out/grep a*xyz=C2=A0 But on 2.6.0, I receive this error: Not a valid JAR: /home/mahmood/bigdatabench/apache/hadoop-2.6.0/hadoop-exam= ples-*.jar Indeed there is no such file in that folder. So I guess it has been moved t= o another folder. However, there are three jar files in 2.6.0 /home/mahmood/bigdatabench/apache/hadoop-2.6.0/share/hadoop/mapreduce/sourc= es/hadoop-mapreduce-examples-2.6.0-sources.jar /home/mahmood/bigdatabench/apache/hadoop-2.6.0/share/hadoop/mapreduce/sourc= es/hadoop-mapreduce-examples-2.6.0-test-sources.jar /home/mahmood/bigdatabench/apache/hadoop-2.6.0/share/hadoop/mapreduce/hadoo= p-mapreduce-examples-2.6.0.jar Which one should I use? Regards, Mahmood ------=_Part_7180237_623078208.1429428487447 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Thanks that fixe= d the error however, still it cannot be run like the previous version.

The command is
time ${HADOOP_HOME}/bin/hadoop jar&= nbsp; ${HADOOP_HOME}/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0= .jar grep ${WORK_DIR}/data-MicroBenchmarks/in ${WORK_DIR}/data-MicroBenchma= rks/out/grep a*xyz

where  ${WORK_DIR}=3D`pwd`

Here is the output

[mahmood@tiger MicroBenchmarks]$ = pwd
/home/mahmood/bigdatabench/BigDataBench_V3.1_H= adoop_Hive/MicroBenchmarks
=
[mahmood= @tiger MicroBenchmarks]$ hadoop fs -ls /home/mahmood/bigdatabench/BigDataBe= nch_V3.1_Hadoop_Hive/MicroBenchmarks/data-MicroBenchmarks/in/in
15/04/19 11:56:26 WARN util.NativeCodeLoader: Unable to load = native-hadoop library for your platform... using builtin-java classes where= applicable
Found 2 items
-rw-r--r--   1 mahmood supergroup  524149543 2015-04-19 10:= 19 /home/mahmood/bigdatabench/BigDataBench_V3.1_Hadoop_Hive/MicroBenchmarks= /data-MicroBenchmarks/in/in/lda_wiki1w_1
-rw-r--r-= -   1 mahmood supergroup  526316345 2015-04-19 10:19 /home/m= ahmood/bigdatabench/BigDataBench_V3.1_Hadoop_Hive/MicroBenchmarks/data-Micr= oBenchmarks/in/in/lda_wiki1w_2


=
....
15/04/19 11:57:0= 6 INFO mapred.MapTask: Starting flush of map output
15/04/19 11:57:06 INFO mapred.LocalJobRunner: map task executor complete.=
15/04/19 11:57:06 WARN mapred.LocalJobRunner: job= _local962861772_0001
java.lang.Exception: java.io.= FileNotFoundException: Path is not a file: /home/mahmood/bigdatabench/BigDa= taBench_V3.1_Hadoop_Hive/MicroBenchmarks/data-MicroBenchmarks/in/in
        at org.apache.= hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:70)
        at org.apache.h= adoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:56)
        at org.apache.hado= op.hdfs.server.namenode.FSNamesystem.getBlockLocationsUpdateTimes(FSNamesys= tem.java:1891)
...
 <= /div>


=

As = you can see, it says the path is not valid but the files are actually there= .

<= /div>
Regar= ds,
Mahmood



On Sunday, April 19, 2015 10:47= AM, Chris Nauroth <cnauroth@hortonworks.com> wrote:

Hello Mahmood,

You want the hadoop-mapreduce-examples-2.6.0.jar file.  The grep = job (as well as other example jobs like wordcount) reside in this jar file = for the 2.x line of the codebase.

Chris Nauroth
Hortonworks


From: Mahmood Naderan <nt_mahmood@yahoo.com&g= t;
Reply-To: User <user@hadoop.apache.org>,= Mahmood Naderan <nt_mahmood@yahoo.com>
Date: Saturday, April 18, 2015 at = 10:59 PM
To: User <user@hadoop.apache.org>
Subject: Again incompatibility, lo= cating example jars

= Hi,
There is another incomp= atibility between 1.2.0 and 2.2.6. I appreciate is someone help to figure i= t out.
This c= ommand works on 1.2.0
time ${HADOOP_HOME}/bin= /hadoop jar  ${HADOOP_HOME}/hadoop-examples-*.jar grep ${WORK_DIR}/dat= a-MicroBenchmarks/in ${WORK_DIR}/data-MicroBenchmarks/out/grep a*xyz=
 

But on= 2.6.0, I receive this error:

Not a = valid JAR: /home/mahmood/bigdatabench/apache/hadoop-2.6.0/hadoop-examples-*= .jar

Indeed there is no such file in that folder. S= o I guess it has been moved to another folder. However, there are three jar= files in 2.6.0

/home/mahmood/bigdatabench/apache/hadoop-2.6.0= /share/hadoop/mapreduce/sources/hadoop-mapreduce-examples-2.6.0-sources.jar=
/home/mahmood/bigdatabench/apache/hadoop-2.6.0/share/hadoop/mapreduce/sourc= es/hadoop-mapreduce-examples-2.6.0-test-sources.jar
/home/mahmood/bigdatabench/apache/hadoop-2.6.0/share/hadoop/mapreduce/hadoo= p-mapreduce-examples-2.6.0.jar


Which one should I use?=

Regards,
Mahmood


------=_Part_7180237_623078208.1429428487447--