hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Zheng Shao <zsh...@gmail.com>
Subject Re: First import into new partition disappears
Date Wed, 30 Dec 2009 06:29:39 GMT
What is the import query? Do you mean "load data"?
Can you give an example?

Zheng

On Tue, Dec 29, 2009 at 10:22 PM, Saurabh Nanda <saurabhnanda@gmail.com> wrote:
> Also has something changed drastically in Hive over the last 2-3 months? A
> simply import query seems to be taking forever now!
>
> Saurabh.
>
> On Wed, Dec 30, 2009 at 11:48 AM, Saurabh Nanda <saurabhnanda@gmail.com>
> wrote:
>>
>> I'm taking a look at the HDFS directories through the web interface and I
>> can see only 5 files there, not 6. I tried creating the partition using the
>> ADD PARTITION command. After that all 6 files get imported successfully.
>>
>> Saurabh.
>>
>> On Wed, Dec 30, 2009 at 11:39 AM, Zheng Shao <zshao9@gmail.com> wrote:
>>>
>>> Can you list the HDFS directories? Are the files in the corresponding
>>> directories yet?
>>>
>>>
>>> Zheng
>>>
>>> On Tue, Dec 29, 2009 at 9:57 PM, Saurabh Nanda <saurabhnanda@gmail.com>
>>> wrote:
>>> > Hi,
>>> >
>>> > I'm revisiting Hive after a long hiatus, so I may not be aware of any
>>> > new
>>> > developments. I had written a script some time back to import webserver
>>> > logs
>>> > for a day into a new partition. The same script now running on the
>>> > latest
>>> > version of Hive (r894548 compiled off trunk) seems to be misbehaving.
>>> >
>>> > I'm importing about 6 files into each partition. However, after the
>>> > script
>>> > ends, only 5 files show up in each partition. Do I need to explicitly
>>> > issue
>>> > the ADD PARTITION command before loading data? Isn't the partition
>>> > implicitly created?
>>> >
>>> > Saurabh.
>>> > --
>>> > http://nandz.blogspot.com
>>> > http://foodieforlife.blogspot.com
>>> >
>>>
>>>
>>>
>>> --
>>> Yours,
>>> Zheng
>>
>>
>>
>> --
>> http://nandz.blogspot.com
>> http://foodieforlife.blogspot.com
>
>
>
> --
> http://nandz.blogspot.com
> http://foodieforlife.blogspot.com
>



-- 
Yours,
Zheng

Mime
View raw message