hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Adriaan Tijsseling <adri...@tijsseling.com>
Subject Re: Loading data into hive table from stdin
Date Mon, 12 Sep 2011 14:20:30 GMT
Thanks, that seems to be the proper alternative. 

Adriaan

On 2011/09/12, at 16:05, Vikas Srivastava wrote:

> No,
> but what you can do is to write a general script to read files from the
> folder and store it into list then retrive the file from list and load them
> into desire path.
> 
> On Mon, Sep 12, 2011 at 7:24 PM, Adriaan Tijsseling
> <adriaan@tijsseling.com>wrote:
> 
>> Sorry, I wasn't clear. What I meant was if the data in path $path can
>> itself be a script that feeds the data in streaming fashion? Something like
>> "load data using script 'loader.py' into table foo".
>> 
>> On 2011/09/12, at 15:36, Vikas Srivastava wrote:
>> 
>>> hive -e "load data local in path '$path' into table $table
>>> partition(date='$date')"
>>> 
>>> On Mon, Sep 12, 2011 at 7:04 PM, Adriaan Tijsseling
>>> <adriaan@tijsseling.com>wrote:
>>> 
>>>> Do you have the syntax for the proper hive QL command?
>>>> 
>>>> Thanks!
>>>> 
>>>> On 2011/09/12, at 15:23, Vikas Srivastava wrote:
>>>> 
>>>>> ya you can simple load the data by a simple script without using any
>> api
>>>> or
>>>>> anything!!
>>>>> 
>>>>> On Mon, Sep 12, 2011 at 6:29 PM, Adriaan Tijsseling
>>>>> <adriaan@tijsseling.com>wrote:
>>>>> 
>>>>>> Is it possible to load data into a hive table that is fed in using
a
>>>> unix
>>>>>> pipe or streamed via a script? I've only seen streaming options when
>>>> using
>>>>>> SELECT TRANSFORM.
>>>>>> 
>>>>>> Thanks in advance,
>>>>>> 
>>>>>> Adriaan
>>>>>> 
>>>>>> 
>>>>> 
>>>>> 
>>>>> --
>>>>> With Regards
>>>>> Vikas Srivastava
>>>>> 
>>>>> DWH & Analytics Team
>>>>> Mob:+91 9560885900
>>>>> One97 | Let's get talking !
>>>> 
>>>> 
>>> 
>>> 
>>> --
>>> With Regards
>>> Vikas Srivastava
>>> 
>>> DWH & Analytics Team
>>> Mob:+91 9560885900
>>> One97 | Let's get talking !
>> 
>> 
> 
> 
> -- 
> With Regards
> Vikas Srivastava
> 
> DWH & Analytics Team
> Mob:+91 9560885900
> One97 | Let's get talking !


Mime
View raw message