tajo-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "David Chen" <dc...@linkedin.com>
Subject Re: Review Request 19786: TAJO-714: Enable setting Parquet tuning parameters
Date Tue, 01 Apr 2014 04:06:03 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/19786/
-----------------------------------------------------------

(Updated April 1, 2014, 4:06 a.m.)


Review request for Tajo.


Bugs: TAJO-714
    https://issues.apache.org/jira/browse/TAJO-714


Repository: tajo


Description
-------

Enable setting Parquet parameters such as row group size, page size, compression, and dictionary
encoding.

For example:

create table table1_parquet (
    id int,
    name text,
    score float,
    type text)
  using parquet with (
    'parquet.page.size'='65536',
    'parquet.block.size'='536870912',
    'parquet.compression'='snappy')
  as select * from table1;


Diffs (updated)
-----

  pom.xml 042111984c41de3b56d26ec00969dd3e59a064cb 
  tajo-catalog/tajo-catalog-common/pom.xml a4db647f4b642cbe11c466974eeec23c553e583e 
  tajo-catalog/tajo-catalog-common/src/main/java/org/apache/tajo/catalog/CatalogConstants.java
c7116f6989a189d5330ae4f0e08296d3b2e62932 
  tajo-catalog/tajo-catalog-common/src/main/java/org/apache/tajo/catalog/CatalogUtil.java
22f54ca651cd02b5913034ea07fd8512b7ff88b4 
  tajo-storage/pom.xml 9f144bb206820d23238532f158b511974f518592 
  tajo-storage/src/main/java/org/apache/tajo/storage/parquet/ParquetAppender.java cb2f2436be19eac56e53a155bbcdb78ceb7de580

  tajo-storage/src/main/java/org/apache/tajo/storage/parquet/ParquetScanner.java 086f490eaf91c433eb46d6443bf5fe111b6b0f81

  tajo-storage/src/test/java/org/apache/tajo/storage/TestMergeScanner.java ad12c06ec50f95bdb166f4764914790f31d48a26

  tajo-storage/src/test/java/org/apache/tajo/storage/TestStorages.java b5338ff1e2066cf4bf6bb5f0a4fd6bbbf8e7633b

  tajo-storage/src/test/java/org/apache/tajo/storage/v2/TestStorages.java ad49b363c1f647357ee4ace0a59c34e64aeb9f0b


Diff: https://reviews.apache.org/r/19786/diff/


Testing
-------

Manual testing using above query.


Thanks,

David Chen


Mime
View raw message