Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2313310D79 for ; Tue, 27 Aug 2013 19:08:32 +0000 (UTC) Received: (qmail 34599 invoked by uid 500); 27 Aug 2013 19:08:26 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 33927 invoked by uid 500); 27 Aug 2013 19:08:23 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 33911 invoked by uid 99); 27 Aug 2013 19:08:22 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 27 Aug 2013 19:08:22 +0000 X-ASF-Spam-Status: No, hits=1.8 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of hadoop.guy0303@gmail.com designates 209.85.216.171 as permitted sender) Received: from [209.85.216.171] (HELO mail-qc0-f171.google.com) (209.85.216.171) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 27 Aug 2013 19:08:15 +0000 Received: by mail-qc0-f171.google.com with SMTP id n1so2892440qcw.30 for ; Tue, 27 Aug 2013 12:07:55 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=5uxjsSqQsxqV0iykharJT/zsGnfCg3NueGYhdKhvbhw=; b=Albiy/4fewdtPH4TyOoXWwfsc6RAa1HczqI+ZT9CX3+I+snFQsw6YDlh7Byy65sB4S Yau3MoOOR+t7UFMcxNTtzvJk/wKJsTPkw4wgWgkH14iXFQPXi8/9jpE2zGJMHFPeCEy8 GHSv1vGPZEQ/PFvedjCQVQkf2/7r5Z6K3lBWxBpSGu0DBxxti0za8KLoj5XRrlvKo6XV wL94je/zbMV9z54p/bEvZOVuLOQzJId37hXlWjp/GVWZeuFnIWtda6JID+YKfoyLAIbc K/snA7hMYQP9UewnlC8I7a4PdmbKvTjyN4w3Ob+klLgYNElrlhlm0tUP83Ex6nX23gbd 7Ecg== MIME-Version: 1.0 X-Received: by 10.49.12.228 with SMTP id b4mr25341986qec.42.1377630475089; Tue, 27 Aug 2013 12:07:55 -0700 (PDT) Received: by 10.224.152.5 with HTTP; Tue, 27 Aug 2013 12:07:55 -0700 (PDT) Date: Wed, 28 Aug 2013 00:37:55 +0530 Message-ID: Subject: Creation of symlink from failed From: Pradeep Singh To: Hadoop user mailing list Content-Type: multipart/alternative; boundary=047d7b5d88e119836204e4f297c3 X-Virus-Checked: Checked by ClamAV on apache.org --047d7b5d88e119836204e4f297c3 Content-Type: text/plain; charset=ISO-8859-1 Hi All , I am trying to run a simple steaming command as mentioned below . bin/hadoop jar /windows/Hadoop/hadoop-1.2.1/contrib/streaming/hadoop-streaming-1.2.1.jar -input /usr/pradeep/input/'Good words' -output /usr/pradeep/output mapper /bin/cat reducer /bin/wc -w I am getting below as message in the error file packageJobJar: [/tmp/hadoop-root/hadoop-unjar3249316336279467583/] [] /tmp/streamjob1400561611088699684.jar tmpDir=null 13/08/27 23:55:54 INFO util.NativeCodeLoader: Loaded the native-hadoop library 13/08/27 23:55:54 WARN snappy.LoadSnappy: Snappy native library not loaded 13/08/27 23:55:54 INFO mapred.FileInputFormat: Total input paths to process : 1 13/08/27 23:55:55 INFO streaming.StreamJob: getLocalDirs(): [/tmp/hadoop-root/mapred/local] 13/08/27 23:55:55 INFO streaming.StreamJob: Running job: job_201308272335_0004 13/08/27 23:55:55 INFO streaming.StreamJob: To kill this job, run: 13/08/27 23:55:55 INFO streaming.StreamJob: /windows/Hadoop/hadoop-1.2.1/libexec/../bin/hadoop job -Dmapred.job.tracker=localhost:9001 -kill job_201308272335_0004 13/08/27 23:55:55 INFO streaming.StreamJob: Tracking URL: http://localhost:50030/jobdetails.jsp?jobid=job_201308272335_0004 13/08/27 23:55:56 INFO streaming.StreamJob: map 0% reduce 0% 13/08/27 23:56:21 INFO streaming.StreamJob: map 100% reduce 100% 13/08/27 23:56:21 INFO streaming.StreamJob: To kill this job, run: 13/08/27 23:56:21 INFO streaming.StreamJob: /windows/Hadoop/hadoop-1.2.1/libexec/../bin/hadoop job -Dmapred.job.tracker=localhost:9001 -kill job_201308272335_0004 13/08/27 23:56:21 INFO streaming.StreamJob: Tracking URL: http://localhost:50030/jobdetails.jsp?jobid=job_201308272335_0004 13/08/27 23:56:21 ERROR streaming.StreamJob: Job not successful. Error: JobCleanup Task Failure, Task: task_201308272335_0004_m_000002 13/08/27 23:56:21 INFO streaming.StreamJob: killJob... Streaming Command Failed! I checked the log and this is what i found : MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201308272335_0004_m_000002" TASK_ATTEMPT_ID="attempt_201308272335_0004_m_000002_0" TASK_STATUS="FAILED" FINISH_TIME="1377627971824" HOSTNAME="pradeep-pc" ERROR="java\.lang\.Throwable: Child Error at org\.apache\.hadoop\.mapred\.TaskRunner\.run(TaskRunner\.java:271) Caused by: java\.io\.IOException: Creation of symlink from /windows/Hadoop/hadoop-1\.2\.1/libexec/\.\./logs/userlogs/job_201308272335_0004/attempt_201308272335_0004_m_000002_0 to /tmp/hadoop-root/mapred/local/userlogs/job_201308272335_0004/attempt_201308272335_0004_m_000002_0 failed\. at org\.apache\.hadoop\.mapred\.TaskLog\.createTaskAttemptLogDir(TaskLog\.java:110) at org\.apache\.hadoop\.mapred\.DefaultTaskController\.createLogDir(DefaultTaskController\.java:71) at org\.apache\.hadoop\.mapred\.TaskRunner\.prepareLogFiles(TaskRunner\.java:316) at org\.apache\.hadoop\.mapred\.TaskRunner\.run(TaskRunner\.java:228) Cant understand the reason for such error .Everything seems to be fine .Would appreicate any help in this respect . Regards Pradeep Singh --047d7b5d88e119836204e4f297c3 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hi All ,
I am trying to run a simple steaming command as mentioned below = .

=A0bin/hadoop jar /windows/Hadoop/hadoop-1.2.1/contrib/streaming/hadoop= -streaming-1.2.1.jar -input /usr/pradeep/input/'Good words' -output= /usr/pradeep/output mapper /bin/cat reducer /bin/wc -w

 I am getting below as messag= e in the error file

packageJobJar: [/tmp/hadoop-root/hadoop-unjar32= 49316336279467583/] [] /tmp/streamjob1400561611088699684.jar tmpDir=3Dnull<= br> 13/08/27 23:55:54 INFO util.NativeCodeLoader: Loaded the native-hadoop libr= ary
13/08/27 23:55:54 WARN snappy.LoadSnappy: Snappy native library not = loaded
13/08/27 23:55:54 INFO mapred.FileInputFormat: Total input paths = to process : 1
13/08/27 23:55:55 INFO streaming.StreamJob: getLocalDirs(): [/tmp/hadoop-ro= ot/mapred/local]
13/08/27 23:55:55 INFO streaming.StreamJob: Running job= : job_201308272335_0004
13/08/27 23:55:55 INFO streaming.StreamJob: To k= ill this job, run:
13/08/27 23:55:55 INFO streaming.StreamJob: /windows/Hadoop/hadoop-1.2.1/li= bexec/../bin/hadoop job=A0 -Dmapred.job.tracker=3Dlocalhost:9001 -kill job_= 201308272335_0004
13/08/27 23:55:55 INFO streaming.StreamJob: Tracking U= RL: http://localhost:50030/jobdetails.jsp?jobid=3Djob_201308272335_000= 4
13/08/27 23:55:56 INFO streaming.StreamJob:=A0 map 0%=A0 reduce 0%
13/08= /27 23:56:21 INFO streaming.StreamJob:=A0 map 100%=A0 reduce 100%
13/08/= 27 23:56:21 INFO streaming.StreamJob: To kill this job, run:
13/08/27 23= :56:21 INFO streaming.StreamJob: /windows/Hadoop/hadoop-1.2.1/libexec/../bi= n/hadoop job=A0 -Dmapred.job.tracker=3Dlocalhost:9001 -kill job_20130827233= 5_0004
13/08/27 23:56:21 INFO streaming.StreamJob: Tracking URL: http://local= host:50030/jobdetails.jsp?jobid=3Djob_201308272335_0004
13/08/27 23:= 56:21 ERROR streaming.StreamJob: Job not successful. Error: JobCleanup Task= Failure, Task: task_201308272335_0004_m_000002
13/08/27 23:56:21 INFO streaming.StreamJob: killJob...
Streaming Command= Failed!

I checked the log and this is what i found :
MapAttempt TASK_TYPE=3D&qu= ot;CLEANUP" TASKID=3D"task_201308272335_0004_m_000002" TASK_= ATTEMPT_ID=3D"attempt_201308272335_0004_m_000002_0" TASK_STATUS= =3D"FAILED" FINISH_TIME=3D"1377627971824" HOSTNAME=3D&q= uot;pradeep-pc" ERROR=3D"java\.lang\.Throwable: Child Error
=A0=A0=A0 at org\.apache\.hadoop\.mapred\.TaskRunner\.run(TaskRunner\.java:= 271)
Caused by: java\.io\.IOException: Creation of symlink from /windows= /Hadoop/hadoop-1\.2\.1/libexec/\.\./logs/userlogs/job_201308272335_0004/att= empt_201308272335_0004_m_000002_0 to /tmp/hadoop-root/mapred/local/userlogs= /job_201308272335_0004/attempt_201308272335_0004_m_000002_0 failed\.
=A0=A0=A0 at org\.apache\.hadoop\.mapred\.TaskLog\.createTaskAttemptLogDir(= TaskLog\.java:110)
=A0=A0=A0 at org\.apache\.hadoop\.mapred\.DefaultTask= Controller\.createLogDir(DefaultTaskController\.java:71)
=A0=A0=A0 at or= g\.apache\.hadoop\.mapred\.TaskRunner\.prepareLogFiles(TaskRunner\.java:316= )
=A0=A0=A0 at org\.apache\.hadoop\.mapred\.TaskRunner\.run(TaskRunner\.java:= 228)

Can= t understand the reason for such error .Everything seems to be fine .Would = appreicate any help in this respect .

Regards
= Pradeep Singh
--047d7b5d88e119836204e4f297c3--