hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From 无名氏 <sitong1...@gmail.com>
Subject Why does throw java.io.IOException when I run a job?
Date Mon, 12 Apr 2010 02:28:01 GMT
hi

I received an IOException when I run a job ...
java.io.IOException: xceiverCount 257 exceeds the limit of concurrent
xcievers 256
    at
org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:88)
    at java.lang.Thread.run(Thread.java:619)

But I have configured dfs.datanode.max.xcievers to 4096.

*core-site.xml*
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
  <name>hadoop.tmp.dir</name>
  <value>/home/${user.name}/tmp/hadoop</value>
  <description>A base for other temporary directories.</description>
</property>
<property>
<name>fs.default.name</name>
<value>hdfs://search9b.cm3:9000</value>
</property>
<property>
*<name>dfs.datanode.max.xcievers</name>
<values>4096</values>*
</property>
<property>
<name>fs.inmemory.size.mb</name>
<values>200</values>
</property>
<property>
<name>io.sort.factor</name>
<values>100</values>
</property>
<property>
<name>io.sort.mb</name>
<values>200</values>
</property>
<property>
<name>io.file.buffer.size</name>
<values>131072</values>
</property>
<property>
<name>mapred.job.tracker.handler.count</name>
<values>60</values>
</property>
<property>
<name>mapred.reduce.parallel.copies</name>
<values>50</values>
</property>
<property>
<name>tasktracker.http.threads</name>
<values>50</values>
</property>
<property>
<name>mapred.child.java.opts</name>
<values>-Xmx1024M</values>
</property>
</configuration>

*hdfs-site.xml*
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
<name>dfs.data.dir</name>
<value>dfs/data</value>
</property>
<property>
<name>dfs.name.dir</name>
<value>dfs/name</value>
</property>
<property>
*<name>dfs.datanode.max.xcievers</name>
<values>4096</values>*
</property>
<property>
<name>dfs.namenode.handler.count</name>
<values>40</values>
</property>
<property>
<name>dfs.datanode.handler.coun</name>
<values>9</values>
</property>
</configuration>

thks.

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message