Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 5ED4B18C51 for ; Wed, 16 Dec 2015 07:16:28 +0000 (UTC) Received: (qmail 91128 invoked by uid 500); 16 Dec 2015 07:16:22 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 91006 invoked by uid 500); 16 Dec 2015 07:16:22 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 90996 invoked by uid 99); 16 Dec 2015 07:16:22 -0000 Received: from Unknown (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 16 Dec 2015 07:16:22 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id D0B4BC3792 for ; Wed, 16 Dec 2015 07:16:21 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.979 X-Spam-Level: ** X-Spam-Status: No, score=2.979 tagged_above=-999 required=6.31 tests=[HTML_MESSAGE=3, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Received: from mx1-us-east.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id Y3gISp6HgFWe for ; Wed, 16 Dec 2015 07:16:20 +0000 (UTC) Received: from BAY004-OMC2S22.hotmail.com (bay004-omc2s22.hotmail.com [65.54.190.97]) by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) with ESMTPS id 6AA0542A20 for ; Wed, 16 Dec 2015 07:16:20 +0000 (UTC) Received: from BAY176-DS21 ([65.54.190.125]) by BAY004-OMC2S22.hotmail.com over TLS secured channel with Microsoft SMTPSVC(7.5.7601.23008); Tue, 15 Dec 2015 23:16:13 -0800 X-TMN: [qE7gi/VYhpdu3VS8UmAFfYbLMm24QBn/] X-Originating-Email: [yaoxiaohua@outlook.com] Message-ID: From: yaoxiaohua To: Subject: hadoop datanode read or write block error Date: Wed, 16 Dec 2015 15:16:06 +0800 MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_NextPart_000_0012_01D13814.AFB681D0" X-Mailer: Microsoft Outlook 14.0 Thread-Index: AdE30Z+m34RzqvQCT8m3muwmoz6MEQ== Content-Language: zh-cn X-OriginalArrivalTime: 16 Dec 2015 07:16:13.0477 (UTC) FILETIME=[A57FE550:01D137D1] ------=_NextPart_000_0012_01D13814.AFB681D0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Hi , This is my first email to ask question for hadoop. Hadoop version hadoop2.3 Jdk : ibm jdk 1.7 Issues: I found a lot of error in the data node process log like this: 2015-12-16 14:54:28,438 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Receiving BP-426197605-10.19.206.101-1406809206259:blk_1251972645_178255413 src: /172.19.206.118:58220 dest: /172.19.206.142:50011 2015-12-16 14:54:31,898 WARN org.apache.hadoop.util.Shell: Could not get disk usage information java.io.IOException: Expecting a line not the end of stream at org.apache.hadoop.fs.DU.parseExecResult(DU.java:233) at org.apache.hadoop.util.Shell.runCommand(Shell.java:487) at org.apache.hadoop.util.Shell.run(Shell.java:418) at org.apache.hadoop.fs.DU.run(DU.java:190) at org.apache.hadoop.fs.DU$DURefreshThread.run(DU.java:119) at java.lang.Thread.run(Thread.java:809) 2015-12-16 14:54:32,189 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: IOException in offerService java.io.IOException: Expecting a line not the end of stream at org.apache.hadoop.fs.DU.parseExecResult(DU.java:233) at org.apache.hadoop.util.Shell.runCommand(Shell.java:487) at org.apache.hadoop.util.Shell.run(Shell.java:418) at org.apache.hadoop.fs.DU.run(DU.java:190) at org.apache.hadoop.fs.DU$DURefreshThread.run(DU.java:119) at java.lang.Thread.run(Thread.java:809) ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: px42pub:50011:DataXceiver error processing WRITE_BLOCK operation src: /172.19.206.138:47717 dest: /172.19.206.142:50011 java.lang.IllegalStateException: Current state = RESET, new state = FLUSHED at java.nio.charset.CharsetEncoder.throwIllegalStateException(CharsetEncoder.ja va:968) at java.nio.charset.CharsetEncoder.flush(CharsetEncoder.java:657) at java.nio.charset.CharsetEncoder.encode(CharsetEncoder.java:786) at org.apache.hadoop.io.Text.encode(Text.java:443) at org.apache.hadoop.io.Text.set(Text.java:198) at org.apache.hadoop.io.Text.(Text.java:88) at org.apache.hadoop.hdfs.protocolPB.PBHelper.convert(PBHelper.java:714) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver. java:124) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.jav a:71) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:229) at java.lang.Thread.run(Thread.java:809) could you give me any suggestion for this? Thanks. Best Regards, Evan Yao ------=_NextPart_000_0012_01D13814.AFB681D0 Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

Hi = ,

         &= nbsp;      This is my first email to ask = question for hadoop.

Hadoop version = hadoop2.3

Jdk : ibm jdk = 1.7

Issues:

I found a lot of error in the data node process log = like this:

2015-12-16 14:54:28,438 = INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Receiving = BP-426197605-10.19.206.101-1406809206259:blk_1251972645_178255413 src: = /172.19.206.118:58220 dest: /172.19.206.142:50011

2015-12-16 14:54:31,898 WARN = org.apache.hadoop.util.Shell: Could not get disk usage = information

java.io.IOException: = Expecting a line not the end of stream

        at = org.apache.hadoop.fs.DU.parseExecResult(DU.java:233)

        at = org.apache.hadoop.util.Shell.runCommand(Shell.java:487)

        at = org.apache.hadoop.util.Shell.run(Shell.java:418)

        at = org.apache.hadoop.fs.DU.run(DU.java:190)

        at = org.apache.hadoop.fs.DU$DURefreshThread.run(DU.java:119)

        at = java.lang.Thread.run(Thread.java:809)

2015-12-16 14:54:32,189 WARN = org.apache.hadoop.hdfs.server.datanode.DataNode: IOException in = offerService

java.io.IOException: = Expecting a line not the end of stream

        at = org.apache.hadoop.fs.DU.parseExecResult(DU.java:233)

        at = org.apache.hadoop.util.Shell.runCommand(Shell.java:487)

        at = org.apache.hadoop.util.Shell.run(Shell.java:418)

        at = org.apache.hadoop.fs.DU.run(DU.java:190)

        at = org.apache.hadoop.fs.DU$DURefreshThread.run(DU.java:119)

        at = java.lang.Thread.run(Thread.java:809)

ERROR = org.apache.hadoop.hdfs.server.datanode.DataNode: = px42pub:50011:DataXceiver error processing WRITE_BLOCK operation  =

 src: /172.19.206.138:47717 = dest: /172.19.206.142:50011

java.lang.IllegalStateException: Current state =3D = RESET, new state =3D FLUSHED

        at = java.nio.charset.CharsetEncoder.throwIllegalStateException(CharsetEncoder= .java:968)

        at = java.nio.charset.CharsetEncoder.flush(CharsetEncoder.java:657)=

        at = java.nio.charset.CharsetEncoder.encode(CharsetEncoder.java:786)

        at = org.apache.hadoop.io.Text.encode(Text.java:443)

        at = org.apache.hadoop.io.Text.set(Text.java:198)

        at = org.apache.hadoop.io.Text.<init>(Text.java:88)

        at = org.apache.hadoop.hdfs.protocolPB.PBHelper.convert(PBHelper.java:714)

        at = org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiv= er.java:124)

        at = org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.= java:71)

        at = org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:2= 29)

        at = java.lang.Thread.run(Thread.java:809)

 

could you = give me any suggestion for this?

 

Thanks.

 

Best = Regards,

Evan Yao

 

------=_NextPart_000_0012_01D13814.AFB681D0--