Return-Path: Delivered-To: apmail-hadoop-core-dev-archive@www.apache.org Received: (qmail 75682 invoked from network); 21 Jul 2008 17:39:54 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 21 Jul 2008 17:39:54 -0000 Received: (qmail 72657 invoked by uid 500); 21 Jul 2008 17:39:52 -0000 Delivered-To: apmail-hadoop-core-dev-archive@hadoop.apache.org Received: (qmail 72637 invoked by uid 500); 21 Jul 2008 17:39:51 -0000 Mailing-List: contact core-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-dev@hadoop.apache.org Delivered-To: mailing list core-dev@hadoop.apache.org Received: (qmail 72626 invoked by uid 99); 21 Jul 2008 17:39:51 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 21 Jul 2008 10:39:51 -0700 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 21 Jul 2008 17:39:06 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 9BF8B234C16C for ; Mon, 21 Jul 2008 10:39:31 -0700 (PDT) Message-ID: <1133134903.1216661971624.JavaMail.jira@brutus> Date: Mon, 21 Jul 2008 10:39:31 -0700 (PDT) From: "Dima Brodsky (JIRA)" To: core-dev@hadoop.apache.org Subject: [jira] Created: (HADOOP-3802) IPC - Heartbeat exceptions filling up log files MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org IPC - Heartbeat exceptions filling up log files ----------------------------------------------- Key: HADOOP-3802 URL: https://issues.apache.org/jira/browse/HADOOP-3802 Project: Hadoop Core Issue Type: Bug Components: ipc Affects Versions: 0.17.1 Environment: Linux 2.6.17-1.2142_FC4smp #1 SMP Tue Jul 11 22:59:20 EDT 2006 x86_64 x86_64 x86_64 GNU/Linux -- Fedora Core 4 Reporter: Dima Brodsky We have a datanode (10.0.0.93) that is in a semi-live state. An ssh session is able to do a connect but is unable to send or receive any data. The connection is closed immediately after the connection is established. Because of this, the name node's logs are full of the following message: 2008-07-21 09:36:10,800 INFO org.apache.hadoop.ipc.Server: IPC Server handler 1on 9000, call sendHeartbeat(10.0.0.193:50010, 917638877184, 20480, 644100882925, 0, 0) from 10.0.0.193:55908: error: org.apache.hadoop.dfs.IncorrectVersionException: Unexpected version of data node. Reported: -11. Expecting = -13. org.apache.hadoop.dfs.IncorrectVersionException: Unexpected version of data node. Reported: -11. Expecting = -13. at org.apache.hadoop.dfs.NameNode.verifyVersion(NameNode.java:682) at org.apache.hadoop.dfs.NameNode.verifyRequest(NameNode.java:669) at org.apache.hadoop.dfs.NameNode.sendHeartbeat(NameNode.java:557) at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:446) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:896) Approximately generating 100MB a minute. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.