Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Date: Mon, 10 Feb 2014 12:27:20 +0000 (UTC)
From: "Lukas Nalezenec (JIRA)" <jira@apache.org>
To: issues@hbase.apache.org
Message-ID: <JIRA.12691031.1390569772453.16624.1392035240206@arcas>
In-Reply-To: <JIRA.12691031.1390569772453@arcas>
References: <JIRA.12691031.1390569772453@arcas>
Subject: [jira] [Commented] (HBASE-10413) Tablesplit.getLength returns 0
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/HBASE-10413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13896438#comment-13896438 ] 

Lukas Nalezenec commented on HBASE-10413:
-----------------------------------------

I have removed  setLength() from TableSplit.
Unit tests are green, I would like to resolve this ticket.

> Tablesplit.getLength returns 0
> ------------------------------
>
>                 Key: HBASE-10413
>                 URL: https://issues.apache.org/jira/browse/HBASE-10413
>             Project: HBase
>          Issue Type: Bug
>          Components: Client, mapreduce
>    Affects Versions: 0.96.1.1
>            Reporter: Lukas Nalezenec
>            Assignee: Lukas Nalezenec
>         Attachments: HBASE-10413-2.patch, HBASE-10413-3.patch, HBASE-10413-4.patch, HBASE-10413-5.patch, HBASE-10413-6.patch, HBASE-10413.patch
>
>
> InputSplits should be sorted by length but TableSplit does not contain real getLength implementation:
>   @Override
>   public long getLength() {
>     // Not clear how to obtain this... seems to be used only for sorting splits
>     return 0;
>   }
> This is causing us problem with scheduling - we have got jobs that are supposed to finish in limited time but they get often stuck in last mapper working on large region.
> Can we implement this method ? 
> What is the best way ?
> We were thinking about estimating size by size of files on HDFS.
> We would like to get Scanner from TableSplit, use startRow, stopRow and column families to get corresponding region than computing size of HDFS for given region and column family. 
> Update:
> This ticket was about production issue - I talked with guy who worked on this and he said our production issue was probably not directly caused by getLength() returning 0. 


--
This message was sent by Atlassian JIRA
(v6.1.5#6160)