Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B8BE6EF26 for ; Mon, 26 Nov 2012 09:29:01 +0000 (UTC) Received: (qmail 46926 invoked by uid 500); 26 Nov 2012 09:29:01 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 46635 invoked by uid 500); 26 Nov 2012 09:29:00 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 46519 invoked by uid 500); 26 Nov 2012 09:28:58 -0000 Delivered-To: apmail-hadoop-hive-dev@hadoop.apache.org Received: (qmail 46514 invoked by uid 99); 26 Nov 2012 09:28:58 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 26 Nov 2012 09:28:58 +0000 Date: Mon, 26 Nov 2012 09:28:58 +0000 (UTC) From: "Gaoshijie (JIRA)" To: hive-dev@hadoop.apache.org Message-ID: <1033261586.22342.1353922138745.JavaMail.jiratomcat@arcas> In-Reply-To: <2024018568.22207.1353917698218.JavaMail.jiratomcat@arcas> Subject: [jira] [Updated] (HIVE-3743) DML Operations , load operation error. MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gaoshijie updated HIVE-3743: ---------------------------- Description: A short period of time operate load command, happen this: the log from hadoop 'hadoop-user-datanode-host.log' java.io.IOException: xceiverCount 256 exceeds the limit of concurrent xcievers 255 at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:92) at java.lang.Thread.run(Thread.java:619) load command like this: LOAD DATA INPATH '/tmp/1' INTO TABLE tb1; LOAD DATA INPATH '/tmp/2' INTO TABLE tb1; .... LOAD DATA INPATH '/tmp/255' INTO TABLE tb1; LOAD DATA INPATH '/tmp/256' INTO TABLE tb1; .... LOAD DATA INPATH '/tmp/1000' INTO TABLE tb1; 8 minutes after per operate. the log from hadoop 'hadoop-user-datanode-host.log' ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(host:50010, storageID=DS-161359523-host-50010-1353919878809, infoPort=50075, ipcPort=50020):DataXceiver java.net.SocketTimeoutException: 480000 millis timeout while waiting for channel to be ready for write. ch : java.nio.channels.SocketChannel[ was: A short period of time operate load command, happen this: the log from hadoop 'hadoop-user-datanode-host.log' java.io.IOException: xceiverCount 256 exceeds the limit of concurrent xcievers 255 at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:92) at java.lang.Thread.run(Thread.java:619) load command like this: LOAD DATA INPATH '/tmp/1' INTO TABLE tb1; LOAD DATA INPATH '/tmp/2' INTO TABLE tb1; .... LOAD DATA INPATH '/tmp/255' INTO TABLE tb1; LOAD DATA INPATH '/tmp/256' INTO TABLE tb1; .... LOAD DATA INPATH '/tmp/1000' INTO TABLE tb1; > DML Operations , load operation error. > -------------------------------------- > > Key: HIVE-3743 > URL: https://issues.apache.org/jira/browse/HIVE-3743 > Project: Hive > Issue Type: Bug > Reporter: Gaoshijie > > A short period of time operate load command, happen this: > the log from hadoop 'hadoop-user-datanode-host.log' > java.io.IOException: xceiverCount 256 exceeds the limit of concurrent xcievers 255 > at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:92) > at java.lang.Thread.run(Thread.java:619) > load command like this: > LOAD DATA INPATH '/tmp/1' INTO TABLE tb1; > LOAD DATA INPATH '/tmp/2' INTO TABLE tb1; > .... > LOAD DATA INPATH '/tmp/255' INTO TABLE tb1; > LOAD DATA INPATH '/tmp/256' INTO TABLE tb1; > .... > LOAD DATA INPATH '/tmp/1000' INTO TABLE tb1; > 8 minutes after per operate. > the log from hadoop 'hadoop-user-datanode-host.log' > ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(host:50010, storageID=DS-161359523-host-50010-1353919878809, infoPort=50075, ipcPort=50020):DataXceiver > java.net.SocketTimeoutException: 480000 millis timeout while waiting for channel to be ready for write. ch : java.nio.channels.SocketChannel[ -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira