hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ted Yu (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (HBASE-2706) Use heuristics to adjust various parameters based on load characteristics
Date Mon, 27 Jan 2014 01:46:40 GMT

     [ https://issues.apache.org/jira/browse/HBASE-2706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ted Yu resolved HBASE-2706.
---------------------------

    Resolution: Duplicate

> Use heuristics to adjust various parameters based on load characteristics
> -------------------------------------------------------------------------
>
>                 Key: HBASE-2706
>                 URL: https://issues.apache.org/jira/browse/HBASE-2706
>             Project: HBase
>          Issue Type: New Feature
>          Components: master
>    Affects Versions: 0.20.4
>            Reporter: Ted Yu
>
> Refer to 'ideas to improve throughput of the base writing' discussion on hbase user mailing
list.
> We should use heuristics to adjust various parameters based on load characteristics.
Factors include, but not limited to, number of CPU (cores) on each node, amount of physical
memory on each node, Heap space allocated to master/region servers.
> HBase parameters shown below would be dynamic whose current values can be seen on master.jsp
/ regionserver.jsp
> For JVM parameters such as -Xmx, master.jsp should display recommended value to user.
> -------------
> Thanks. I will make this change:
> <property>
>  <name>hbase.hregion.memstore.block.multiplier</name>
>  <value>8</value>
> </property>
> <property>
>  <name>hbase.regionserver.msginterval</name>
>  <value>10000</value>
> </property>
>  <property>
>   <name>hbase.hstore.compactionThreshold</name>
>   <value>6</value>
> </property>
> <property>
>  <name>hbase.hstore.blockingStoreFiles</name>
>  <value>18</value>
> </property>
> and see how it goes.
> Jimmy.
> With the above change, the write goes faster if it works, but now we have problem that
the
> insertion doesn't work at all, here is the result:
> 2010-06-09 22:29:04,330 WARN org.apache.hadoop.hdfs.DFSClient: DFS Read: java.io
> .IOException: Could not find target position 0



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message