Mailing-List: contact common-commits-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-dev@hadoop.apache.org
MIME-Version: 1.0
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: quoted-printable
From: Apache Wiki <wikidiffs@apache.org>
To: Apache Wiki <wikidiffs@apache.org>
Date: Mon, 02 Jul 2012 20:36:11 -0000
Message-ID: <20120702203611.30892.23458@eos.apache.org>
Subject: 
 =?utf-8?q?=5BHadoop_Wiki=5D_Update_of_=22Hbase/PoweredBy=22_by_stack?=
Auto-Submitted: auto-generated

Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for ch=
ange notification.

The "Hbase/PoweredBy" page has been changed by stack:
http://wiki.apache.org/hadoop/Hbase/PoweredBy?action=3Ddiff&rev1=3D75&rev2=
=3D76

  =

  [[http://www.openplaces.org|Openplaces]] is a search engine for travel th=
at uses HBase to store terabytes of web pages and travel-related entity rec=
ords (countries, cities, hotels, etc.). We have dozens of MapReduce jobs th=
at crunch data on a daily basis.  We use a 20-node cluster for development,=
 a 40-node cluster for offline production processing and an EC2 cluster for=
 the live web site.
  =

- [[http://www.powerset.com/|Powerset (a Microsoft company)]] uses HBase to=
 store raw documents.  We have a ~110 node hadoop cluster running DFS, mapr=
educe, and hbase.  In our wikipedia hbase table, we have one row for each w=
ikipedia page (~2.5M pages and climbing).  We use this as input to our inde=
xing jobs, which are run in hadoop mapreduce.  Uploading the entire wikiped=
ia dump to our cluster takes a couple hours.  Scanning the table inside map=
reduce is very fast -- the latency is in the noise compared to everything e=
lse we do.
+ [[http://www.pnl.gov|Pacific Northwest National Laboratory]] - Hadoop and=
 HBase (Cloudera distribution) are being used within PNNL's Computational B=
iology & Bioinformatics Group for a systems biology data warehouse project =
that integrates high throughput proteomics and transcriptomics data sets co=
ming from instruments in the Environmental  Molecular Sciences Laboratory, =
a US Department of Energy national user facility located at PNNL. The data =
sets are being merged and annotated with other public genomics information =
in the data warehouse environment, with Hadoop analysis programs operating =
on the annotated data in the HBase tables. This work is hosted by olympus, =
a large PNNL institutional computing cluster (http://www.pnl.gov/news/relea=
se.aspx?id=3D908) , with the HBase tables being stored in olympus's Lustre =
file system.
  =

  [[http://www.readpath.com/|ReadPath]] uses HBase to store several hundred=
 million RSS items and dictionary for its RSS newsreader. Readpath is curre=
ntly running on an 8 node cluster.
 =20