spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Daniel Haviv <daniel.ha...@veracity-group.com>
Subject Re: HiveContext ignores ("skip.header.line.count"="1")
Date Tue, 27 Oct 2015 04:47:04 GMT
I will

Thank you.

> On 27 באוק׳ 2015, at 4:54, Felix Cheung <felixcheung_m@hotmail.com> wrote:
> 
> Please open a JIRA?
> 
>  
> Date: Mon, 26 Oct 2015 15:32:42 +0200
> Subject: HiveContext ignores ("skip.header.line.count"="1")
> From: daniel.haviv@veracity-group.com
> To: user@spark.apache.org
> 
> Hi,
> I have a csv table in Hive which is configured to skip the header row using TBLPROPERTIES("skip.header.line.count"="1").
> When querying from Hive the header row is not included in the data, but when running
the same query via HiveContext I get the header row.
> 
> I made sure that HiveContext sees the skip.header.line.count setting by running "show
create table"
> 
> Any ideas?
> 
> Thank you.
> Daniel

Mime
View raw message