hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From 无名氏 <sitong1...@gmail.com>
Subject Re: Why does throw java.io.IOException when I run a job?
Date Mon, 12 Apr 2010 09:29:33 GMT
I am sorry!
I found the reason that the item "value" was written in the "values".
thks
2010/4/12 Jean-Daniel Cryans <jdcryans@apache.org>

> Did you restart Hadoop after changing the configs? If you get the
> error it means that it wasn't picked up so there's not that many
> things to check (checks that only you can do).
>
> J-D
>
> On Mon, Apr 12, 2010 at 4:28 AM, 无名氏 <sitong1978@gmail.com> wrote:
> > hi
> >
> > I received an IOException when I run a job ...
> > java.io.IOException: xceiverCount 257 exceeds the limit of concurrent
> > xcievers 256
> >    at
> >
> org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:88)
> >    at java.lang.Thread.run(Thread.java:619)
> >
> > But I have configured dfs.datanode.max.xcievers to 4096.
> >
> > *core-site.xml*
> > <?xml version="1.0"?>
> > <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
> > <!-- Put site-specific property overrides in this file. -->
> > <configuration>
> > <property>
> >  <name>hadoop.tmp.dir</name>
> >  <value>/home/${user.name}/tmp/hadoop</value>
> >  <description>A base for other temporary directories.</description>
> > </property>
> > <property>
> > <name>fs.default.name</name>
> > <value>hdfs://search9b.cm3:9000</value>
> > </property>
> > <property>
> > *<name>dfs.datanode.max.xcievers</name>
> > <values>4096</values>*
> > </property>
> > <property>
> > <name>fs.inmemory.size.mb</name>
> > <values>200</values>
> > </property>
> > <property>
> > <name>io.sort.factor</name>
> > <values>100</values>
> > </property>
> > <property>
> > <name>io.sort.mb</name>
> > <values>200</values>
> > </property>
> > <property>
> > <name>io.file.buffer.size</name>
> > <values>131072</values>
> > </property>
> > <property>
> > <name>mapred.job.tracker.handler.count</name>
> > <values>60</values>
> > </property>
> > <property>
> > <name>mapred.reduce.parallel.copies</name>
> > <values>50</values>
> > </property>
> > <property>
> > <name>tasktracker.http.threads</name>
> > <values>50</values>
> > </property>
> > <property>
> > <name>mapred.child.java.opts</name>
> > <values>-Xmx1024M</values>
> > </property>
> > </configuration>
> >
> > *hdfs-site.xml*
> > <?xml version="1.0"?>
> > <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
> > <!-- Put site-specific property overrides in this file. -->
> > <configuration>
> > <property>
> > <name>dfs.data.dir</name>
> > <value>dfs/data</value>
> > </property>
> > <property>
> > <name>dfs.name.dir</name>
> > <value>dfs/name</value>
> > </property>
> > <property>
> > *<name>dfs.datanode.max.xcievers</name>
> > <values>4096</values>*
> > </property>
> > <property>
> > <name>dfs.namenode.handler.count</name>
> > <values>40</values>
> > </property>
> > <property>
> > <name>dfs.datanode.handler.coun</name>
> > <values>9</values>
> > </property>
> > </configuration>
> >
> > thks.
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message