hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "nick dimiduk" <>
Subject Review Request 23824: Add HiveHBaseTableSnapshotInputFormat
Date Tue, 22 Jul 2014 20:27:08 GMT

This is an automatically generated e-mail. To reply, visit:

Review request for hive, Ashutosh Chauhan, Navis Ryu, Sushanth Sowmyan, and Swarnim Kulkarni.

Bugs: HIVE-6584

Repository: hive-git


HBASE-8369 provided mapreduce support for reading from HBase table snapsopts. This allows
a MR job to consume a stable, read-only view of an HBase table directly off of HDFS. Bypassing
the online region server API provides a nice performance boost for the full scan. HBASE-10642
is backporting that feature to 0.94/0.96 and also adding a mapred implementation. Once that's
available, we should add an input format. A follow-on patch could work out how to integrate
this functionality into the StorageHandler, similar to how HIVE-6473 integrates the HFileOutputFormat
into existing table definitions.

See JIRA for further conversation.


  common/src/java/org/apache/hadoop/hive/conf/ 593c566 
  conf/hive-default.xml.template ba922d0 
  hbase-handler/src/java/org/apache/hadoop/hive/hbase/ 998c15c 
  hbase-handler/src/java/org/apache/hadoop/hive/hbase/ dbf5e51 
  hbase-handler/src/java/org/apache/hadoop/hive/hbase/ PRE-CREATION

  hbase-handler/src/java/org/apache/hadoop/hive/hbase/ 1032cc9

  hbase-handler/src/test/queries/positive/hbase_handler_snapshot.q PRE-CREATION 
  hbase-handler/src/test/results/positive/external_table_ppd.q.out 6f1adf4 
  hbase-handler/src/test/results/positive/hbase_binary_storage_queries.q.out b92db11 
  hbase-handler/src/test/results/positive/hbase_handler_snapshot.q.out PRE-CREATION 
  hbase-handler/src/test/templates/TestHBaseCliDriver.vm 01d596a 
  itests/util/src/main/java/org/apache/hadoop/hive/hbase/ 96a0de2 
  itests/util/src/main/java/org/apache/hadoop/hive/hbase/ cdc0a65 
  itests/util/src/main/java/org/apache/hadoop/hive/ql/ 2fefa06 
  pom.xml b5a5697 
  ql/src/java/org/apache/hadoop/hive/ql/exec/ c80a2a3 



Unit tests, local-mode testing, pseudo-distributed mode testing, and tested on a small distributed
cluster. Tests included hbase versions 0.98.3 and the HEAD of 0.98 branch.


nick dimiduk

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message