beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinoth Chandar (JIRA)" <>
Subject [jira] [Commented] (BEAM-1158) Create HiveIO
Date Thu, 15 Dec 2016 02:29:58 GMT


Vinoth Chandar commented on BEAM-1158:

Connecting back to my comment on the ML 

>I would like to do something similar to Spark SQL/HiveContext, but with Beam. 

One more thought, I think the current approach with HiveQL/Native API can also be helpful.
(we can use HiveQL to get the input out, and then use the Spark runner to actually do further
joins, group by etc).

Look forward to this ticket 

> Create HiveIO
> -------------
>                 Key: BEAM-1158
>                 URL:
>             Project: Beam
>          Issue Type: Improvement
>          Components: sdk-java-extensions
>    Affects Versions: Not applicable
>            Reporter: Ismaël Mejía
>            Assignee: Jean-Baptiste Onofré
>            Priority: Minor
> Support for reading and writing to Hive. The HiveIO will directly use the native API
and HiveQL

This message was sent by Atlassian JIRA

View raw message