hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lars George (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HBASE-1829) Make use of start/stop row in TableInputFormat
Date Tue, 03 Nov 2009 12:56:59 GMT

     [ https://issues.apache.org/jira/browse/HBASE-1829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Lars George updated HBASE-1829:
-------------------------------

    Attachment: TestTableInputFormatScan.java
                HBaseTestingUtility.java

I have updated the test to JUnit4 and added a few helpful functions to the test utility class,
like starting a MapReduce cluster. What I have trouble with now is adding the multi region
code. I have added a createMultiRegion(...) method but that previously used some intrinsic
knowledge of how to set up the regions and fill with rows in between. Since I am not sure
if I have to copy that all I stopped short and added a few "FIXME" comments in the utility
class where I am not sure what to do without creating a possibly a mess.

Could someone take my two classes and let me know what I have to do? After that I will add
the appropriate test cases covering all region combinations. I have two already and they complete
successfully - but since the table has only one region it makes no sense yet.

Check the @BeforeClass to see how I intended to use them. Maybe that also needs slight adjustments?

> Make use of start/stop row in TableInputFormat
> ----------------------------------------------
>
>                 Key: HBASE-1829
>                 URL: https://issues.apache.org/jira/browse/HBASE-1829
>             Project: Hadoop HBase
>          Issue Type: Improvement
>          Components: mapred
>    Affects Versions: 0.20.0
>            Reporter: Lars George
>            Assignee: Lars George
>             Fix For: 0.20.2, 0.21.0
>
>         Attachments: HBASE-1829-v2.patch, HBASE-1829.patch, HBaseTestingUtility.java,
TestTableInputFormatScan.java
>
>
> Since we can now specify a start and stop row with the Scan that is handed to the TIF
we can reduce the splits to the regions that contain these rows. That allows to test large
MR jobs on a single region for example.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message