hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhihong Yu (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-5208) Allow setting Scan start/stop row individually in TableInputFormat
Date Mon, 16 Jan 2012 19:55:43 GMT

    [ https://issues.apache.org/jira/browse/HBASE-5208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13187143#comment-13187143
] 

Zhihong Yu commented on HBASE-5208:
-----------------------------------

Running the test based on patch v3 timed out. Here is strace:
{code}
"main" prio=5 tid=101801000 nid=0x100601000 waiting on condition [1005fe000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at org.apache.hadoop.mapred.JobClient.monitorAndPrintJob(JobClient.java:1295)
	at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:498)
	at org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan.testScanFromConfiguration(TestTableInputFormatScan.java:355)
	at org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan.testScanYZYToEmpty(TestTableInputFormatScan.java:319)
{code}

You can use the following command to verify that the new test case passes (just an example):
{code}
mvn test -P localTests TestTableInputFormatScan#testScanEmptyToEmpty
{code}
                
> Allow setting Scan start/stop row individually in TableInputFormat
> ------------------------------------------------------------------
>
>                 Key: HBASE-5208
>                 URL: https://issues.apache.org/jira/browse/HBASE-5208
>             Project: HBase
>          Issue Type: Improvement
>          Components: mapreduce
>            Reporter: Nicholas Telford
>            Priority: Minor
>         Attachments: HBASE-5208-001.txt, HBASE-5208-002.txt, HBASE-5208-003.txt
>
>
> Currently, TableInputFormat initializes a serialized Scan from "hbase.mapreduce.scan".
Alternatively, it will instantiate a new Scan using properties defined in "hbase.mapreduce.scan.*".
However, of these properties the "start row" and "stop row" (arguably the most pertinent)
are missing.
> TableInputFormat should permit the specification of a start/stop row as with the other
fields using a new pair of properties: "hbase.mapreduce.scan.row.start" and "hbase.mapreduce.scan.row.end"
> The primary use-case for this is to permit Oozie and other job management tools that
can't call TableMapReduceUtil.initTableMapperJob() to operate on a contiguous subset of rows.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message