hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aihua Xu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-10755) Rework on HIVE-5193 to enhance the column oriented table acess
Date Mon, 05 Oct 2015 21:27:26 GMT

    [ https://issues.apache.org/jira/browse/HIVE-10755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944083#comment-14944083
] 

Aihua Xu commented on HIVE-10755:
---------------------------------

[~daijy] I'm working on adding the unit tests you mentioned to TestHCatLoader.java. Actually
I have problem to load complex_table with the following code.

{noformat}
   PigServer server = new PigServer(ExecType.LOCAL);
    server.registerQuery("A = load '" + COMPLEX_TABLE + "' using org.apache.hive.hcatalog.pig.HCatLoader();");
    server.registerQuery("B = load '" + COMPLEX_TABLE + "' using org.apache.hive.hcatalog.pig.HCatLoader();");
    server.registerQuery("C = join A by name, B by name;");
    server.registerQuery("D = foreach C generate B::studentid;");
{noformat}

{{Iterator<Tuple> iter = server.openIterator("A");}} won't be able to access the data,
while if I replace with basic_table it's fine.

Don't know too much pig/hcatalog. I'm wondering if I did anything wrong?



> Rework on HIVE-5193 to enhance the column oriented table acess
> --------------------------------------------------------------
>
>                 Key: HIVE-10755
>                 URL: https://issues.apache.org/jira/browse/HIVE-10755
>             Project: Hive
>          Issue Type: Sub-task
>          Components: HCatalog
>    Affects Versions: 1.2.0
>            Reporter: Aihua Xu
>            Assignee: Aihua Xu
>             Fix For: 2.0.0
>
>         Attachments: HIVE-10755.patch
>
>
> Add the support of column pruning for column oriented table access which was done in
HIVE-5193 but was reverted due to the join issue in HIVE-10720.
> In 1.3.0, the patch posted by Viray didn't work, probably due to some jar reference.
That seems to get fixed and that patch works in 2.0.0 now.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message