hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Purtell (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HBASE-2602) full system application test scenario: webtable
Date Sun, 23 May 2010 19:43:24 GMT

     [ https://issues.apache.org/jira/browse/HBASE-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Andrew Purtell updated HBASE-2602:
----------------------------------

    Description: 
Put together a full web content archive toolchain:

* Pluggable content acquisition
    ** Heritrix HBase writer simulator, zipf distribution over [32B, 10MB]
    ** Real Heritrix + Heritrix HBase writer option for running crawls over live sites

* Periodic MapReduce using Tika for extraction

* Katta for search, or hbasene + Solr when ready (better)



  was:
Put together a full web content archive toolchain:

- Pluggable content acquisition
    - Heritrix HBase writer simulator, zipf distribution over [32B, 10MB]
    - Real Heritrix + Heritrix HBase writer option for running crawls over live sites

- Periodic MapReduce using Tika for extraction

- Katta for search, or hbasene + Solr when ready (better)




> full system application test scenario: webtable
> -----------------------------------------------
>
>                 Key: HBASE-2602
>                 URL: https://issues.apache.org/jira/browse/HBASE-2602
>             Project: Hadoop HBase
>          Issue Type: Sub-task
>            Reporter: Andrew Purtell
>
> Put together a full web content archive toolchain:
> * Pluggable content acquisition
>     ** Heritrix HBase writer simulator, zipf distribution over [32B, 10MB]
>     ** Real Heritrix + Heritrix HBase writer option for running crawls over live sites
> * Periodic MapReduce using Tika for extraction
> * Katta for search, or hbasene + Solr when ready (better)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message