Return-Path: Delivered-To: apmail-pig-dev-archive@www.apache.org Received: (qmail 4529 invoked from network); 5 Mar 2011 23:46:10 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 5 Mar 2011 23:46:10 -0000 Received: (qmail 9438 invoked by uid 500); 5 Mar 2011 23:46:10 -0000 Delivered-To: apmail-pig-dev-archive@pig.apache.org Received: (qmail 9417 invoked by uid 500); 5 Mar 2011 23:46:10 -0000 Mailing-List: contact dev-help@pig.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@pig.apache.org Delivered-To: mailing list dev@pig.apache.org Received: (qmail 9408 invoked by uid 500); 5 Mar 2011 23:46:10 -0000 Delivered-To: apmail-hadoop-pig-dev@hadoop.apache.org Received: (qmail 9405 invoked by uid 99); 5 Mar 2011 23:46:10 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 05 Mar 2011 23:46:10 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 05 Mar 2011 23:46:07 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id CB7F157BFC for ; Sat, 5 Mar 2011 23:45:45 +0000 (UTC) Date: Sat, 5 Mar 2011 23:45:45 +0000 (UTC) From: "Dmitriy V. Ryaboy (JIRA)" To: pig-dev@hadoop.apache.org Message-ID: <1933014319.1313.1299368745830.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <17154469.235361296120584060.JavaMail.jira@thor> Subject: [jira] Closed: (PIG-1828) HBaseStorage has problems with processing multiregion tables MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/PIG-1828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy closed PIG-1828. ---------------------------------- > HBaseStorage has problems with processing multiregion tables > ------------------------------------------------------------ > > Key: PIG-1828 > URL: https://issues.apache.org/jira/browse/PIG-1828 > Project: Pig > Issue Type: Bug > Affects Versions: 0.8.0 > Environment: Hadoop 0.20.2, Hbase 0.20.6, Distributed mode > Reporter: Lukas > Assignee: Dmitriy V. Ryaboy > > As brought up in the pig user mailing list (http://www.mail-archive.com/user%40pig.apache.org/msg00606.html) Pig does sometime not scan the full HBase table. > It seems that HBaseStorage has problems scanning large tables. It issues just one mapper job instead of one mapper job per table region. > Ian Stevens, who brought this issue up in the mailing list, attached a script to reproduce the problem (https://gist.github.com/766929). > However, in my case, the problem only occurred, after the table was split into more than one regions. -- This message is automatically generated by JIRA. - For more information on JIRA, see: http://www.atlassian.com/software/jira