hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Navis Ryu" <navis....@nexr.com>
Subject Review Request 23332: Implement data loading from user provided string directly for test
Date Tue, 08 Jul 2014 05:27:38 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/23332/
-----------------------------------------------------------

Review request for hive.


Bugs: HIVE-3227
    https://issues.apache.org/jira/browse/HIVE-3227


Repository: hive-git


Description
-------

{code}
load data instream 'key value\nkey2 value2' into table test;
{code}

This will make test easier and also can reduce test time. For example,
{code}
-- ppr_pushdown.q
create table ppr_test (key string) partitioned by (ds string);
alter table ppr_test add partition (ds = '1234');
insert overwrite table ppr_test partition(ds = '1234') select * from (select '1234' from src
limit 1 union all select 'abcd' from src limit 1) s;
{code}
last query is 4MR job. But can be replaced by
{code}
create table ppr_test (key string) partitioned by (ds string) ROW FORMAT delimited fields
terminated by ' ';
alter table ppr_test add partition (ds = '1234');
load data local instream '1234\nabcd' overwrite into table ppr_test partition(ds = '1234');
{code}


Diffs
-----

  ql/src/java/org/apache/hadoop/hive/ql/parse/HiveLexer.g 412a046 
  ql/src/java/org/apache/hadoop/hive/ql/parse/HiveParser.g f934ac4 
  ql/src/java/org/apache/hadoop/hive/ql/parse/LoadSemanticAnalyzer.java 8bd24d3 
  ql/src/test/queries/clientpositive/load_instream.q PRE-CREATION 
  ql/src/test/results/clientpositive/load_instream.q.out PRE-CREATION 

Diff: https://reviews.apache.org/r/23332/diff/


Testing
-------


Thanks,

Navis Ryu


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message