Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 16D90D38A for ; Fri, 14 Sep 2012 21:51:07 +0000 (UTC) Received: (qmail 50013 invoked by uid 500); 14 Sep 2012 21:51:01 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 49908 invoked by uid 500); 14 Sep 2012 21:51:01 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 49900 invoked by uid 99); 14 Sep 2012 21:51:01 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 14 Sep 2012 21:51:01 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=FSL_RCVD_USER,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [209.85.217.176] (HELO mail-lb0-f176.google.com) (209.85.217.176) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 14 Sep 2012 21:50:55 +0000 Received: by lboi15 with SMTP id i15so3611564lbo.35 for ; Fri, 14 Sep 2012 14:50:33 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type :x-gm-message-state; bh=NSjnqa6eZJ1eb+n5QhxyBgkQSKnTm8ZGvpMProGYqIk=; b=oeJS5aBFkC2wZY1iJRDmyJbmu7zZUMyavbHWHPoCGESTK0dvDllax3PwEyBsLHDZBN Vk93jN0Nk2/5DlbNz1gzuQzZqh+y2pzmYH3DDC5J2gCSDrsns6aqms/aJ+BtivbbdWik Y9XwQqRbWHd99TK8S2ADmF26Eo/Fpq8v6FzbB1CGOd7RAhpUWB7rVWLXpS84ItLdGeWE Mq3ItVx9KSyy/aeqonqdH/z7QLzGhttfB5QjjrFQf0ME2dCthIpfFD+aCFCZzrx8a29g nIDHdX2Cp5C8kVFOwy1FMY51QGOl/Uu73lnkKUKCHWFJCSJqNJiz0S4nyrIn8/Bct//c Vy4Q== MIME-Version: 1.0 Received: by 10.152.147.72 with SMTP id ti8mr3779431lab.20.1347659433153; Fri, 14 Sep 2012 14:50:33 -0700 (PDT) Received: by 10.114.14.98 with HTTP; Fri, 14 Sep 2012 14:50:33 -0700 (PDT) Date: Fri, 14 Sep 2012 17:50:33 -0400 Message-ID: Subject: HDFS Error - BlockReader: error in packet header From: Jason Huang To: user@hadoop.apache.org Content-Type: text/plain; charset=ISO-8859-1 X-Gm-Message-State: ALoCoQl0gznKMckSAYHubGSFy1OqWTMzog611hSF2h+i0Q6pn6A44S8uSZzE+vvl09GtaqhSiOff X-Virus-Checked: Checked by ClamAV on apache.org Hello, Looking for some help in setting up hadoop 1.0.3 in Pseudo distributed mode... I was able to install hadoop, config the .xml files and start all nodes: $ JPS 6645 Jps 6030 SecondaryNameNode 6185 TaskTracker 5851 NameNode 6095 JobTracker 5939 DataNode However, when I tried to play around with a couple of Map-reduce jobs with provided example jar files I got the following errors: (1) $ bin/hadoop jar hadoop-examples-1.0.3.jar pi 10 100 Number of Maps = 10 Samples per Map = 100 Wrote input for Map #0 Wrote input for Map #1 Wrote input for Map #2 Wrote input for Map #3 Wrote input for Map #4 Wrote input for Map #5 Wrote input for Map #6 Wrote input for Map #7 Wrote input for Map #8 Wrote input for Map #9 Starting Job 12/09/14 17:39:06 INFO mapred.FileInputFormat: Total input paths to process : 10 12/09/14 17:39:06 INFO mapred.JobClient: Running job: job_201209141701_0003 12/09/14 17:39:07 INFO mapred.JobClient: map 0% reduce 0% 12/09/14 17:39:16 INFO mapred.JobClient: Task Id : attempt_201209141701_0003_m_000011_0, Status : FAILED Error initializing attempt_201209141701_0003_m_000011_0: java.io.IOException: BlockReader: error in packet header(chunkOffset : 142336, dataLen : 3538944, seqno : 3350829872548206857 (last: 0)) at org.apache.hadoop.hdfs.DFSClient$BlockReader.readChunk(DFSClient.java:1580) (2) $ ./bin/hadoop jar hadoop-examples-1.0.3.jar wordcount /user/jasonhuang/input /user/jasonhuang/output 12/09/14 17:37:51 INFO input.FileInputFormat: Total input paths to process : 1 12/09/14 17:37:51 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 12/09/14 17:37:51 WARN snappy.LoadSnappy: Snappy native library not loaded 12/09/14 17:37:57 INFO mapred.JobClient: Cleaning up the staging area hdfs://localhost:9000/tmp/hadoop-jasonhuang/mapred/staging/jasonhuang/.staging/job_201209141701_0002 12/09/14 17:37:57 ERROR security.UserGroupInformation: PriviledgedActionException as:jasonhuang cause:org.apache.hadoop.ipc.RemoteException: java.io.IOException: java.io.IOException: BlockReader: error in packet header(chunkOffset : 19968, dataLen : 1835351087, seqno : 7023413562532324724 (last: 0)) Does anyone have idea on why the error occurs and how I can fix them? thanks! Jason