pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ted Malaska (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (PIG-2886) Add Scan TimeRange to HBaseStorage
Date Sat, 01 Sep 2012 13:24:07 GMT

     [ https://issues.apache.org/jira/browse/PIG-2886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ted Malaska updated PIG-2886:
-----------------------------

    Attachment: PIG-2886-2.patch

Cleaned things up.  Change maxTimeRange and minTimeRange to maxTimestamp and minTimestamp.
 Plus I added a timestamp option.  Along with unit tests.
                
> Add Scan TimeRange to HBaseStorage 
> -----------------------------------
>
>                 Key: PIG-2886
>                 URL: https://issues.apache.org/jira/browse/PIG-2886
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Ted Malaska
>            Priority: Minor
>         Attachments: PIG-2886-0.patch, PIG-2886-1.patch, PIG-2886-2.patch
>
>
> I have a client that wants to use pig.  They are using MR now.  They can't use PIG right
now because they only want to fetch the last day's worth of data in HBase.  A filter with
time range would require reading all the HStore files.  If we hold major compaction until
after the fetch and use Scan Time Range we only need to read very little in compression. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message