Return-Path: Delivered-To: apmail-incubator-hama-dev-archive@minotaur.apache.org Received: (qmail 71043 invoked from network); 7 May 2009 02:12:54 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 7 May 2009 02:12:54 -0000 Received: (qmail 75810 invoked by uid 500); 7 May 2009 02:12:54 -0000 Delivered-To: apmail-incubator-hama-dev-archive@incubator.apache.org Received: (qmail 75777 invoked by uid 500); 7 May 2009 02:12:53 -0000 Mailing-List: contact hama-dev-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hama-dev@incubator.apache.org Delivered-To: mailing list hama-dev@incubator.apache.org Received: (qmail 75766 invoked by uid 99); 7 May 2009 02:12:53 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 07 May 2009 02:12:53 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 07 May 2009 02:12:51 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 6804629A0012 for ; Wed, 6 May 2009 19:12:30 -0700 (PDT) Message-ID: <200067369.1241662350424.JavaMail.jira@brutus> Date: Wed, 6 May 2009 19:12:30 -0700 (PDT) From: "Edward J. Yoon (JIRA)" To: hama-dev@incubator.apache.org Subject: [jira] Commented: (HAMA-182) Seperate column families In-Reply-To: <1342925853.1241592030426.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HAMA-182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12706698#action_12706698 ] Edward J. Yoon commented on HAMA-182: ------------------------------------- When too many families (100) are in one table, I received below messages. org.apache.hadoop.hbase.client.RetriesExhaustedException: Trying to contact region server 61.247.200.35:60020 for region DenseMatrix_randonmwq,,1241660972061, row '000000000000442', but failed after 10 attempts. Exceptions: java.io.IOException: Call to /61.247.200.35:60020 failed on local exception: java.io.EOFException java.net.ConnectException: Call to /61.247.200.35:60020 failed on connection exception: java.net.ConnectException: Connection refused java.net.ConnectException: Call to /61.247.200.35:60020 failed on connection exception: java.net.ConnectException: Connection refused java.net.ConnectException: Call to /61.247.200.35:60020 failed on connection exception: java.net.ConnectException: Connection refused java.net.ConnectException: Call to /61.247.200.35:60020 failed on connection exception: java.net.ConnectException: Connection refused java.net.ConnectException: Call to /61.247.200.35:60020 failed on connection exception: java.net.ConnectException: Connection refused java.net.ConnectException: Call to /61.247.200.35:60020 failed on connection exception: java.net.ConnectException: Connection refused java.net.ConnectException: Call to /61.247.200.35:60020 failed on connection exception: java.net.ConnectException: Connection refused java.net.ConnectException: Call to /61.247.200.35:60020 failed on connection exception: java.net.ConnectException: Connection refused java.net.ConnectException: Call to /61.247.200.35:60020 failed on connection exception: java.net.ConnectException: Connection refused at org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:841) at org.apache.hadoop.hbase.client.HConnectionManager$TableServers.processBatchOfRows(HConnectionManager.java:932) at org.apache.hadoop.hbase.client.HTable.flushCommits(HTable.java:1372) at org.apache.hadoop.hbase.client.HTable.commit(HTable.java:1316) at org.apache.hadoop.hbase.client.HTable.commit(HTable.java:1296) at org.apache.hama.mapred.VectorOutputFormat$TableRecordWriter.write(VectorOutputFormat.java:71) at org.apache.hama.mapred.VectorOutputFormat$TableRecordWriter.write(VectorOutputFormat.java:51) at org.apache.hadoop.mapred.ReduceTask$3.collect(ReduceTask.java:410) at org.apache.hama.mapred.RandomMatrixReduce.reduce(RandomMatrixReduce.java:71) at org.apache.hama.mapred.RandomMatrixReduce.reduce(RandomMatrixReduce.java:36) at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:436) at org.apache.hadoop.mapred.Child.main(Child.java:158) > Seperate column families > ------------------------ > > Key: HAMA-182 > URL: https://issues.apache.org/jira/browse/HAMA-182 > Project: Hama > Issue Type: Improvement > Components: implementation > Affects Versions: 0.1.0 > Reporter: Edward J. Yoon > Assignee: Edward J. Yoon > Fix For: 0.1.0 > > Attachments: columns.patch > > > The all columns are stored in a single column family. I propose to separate column families by column index range so that we reduces I/O during column-based process. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.