spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Felix Cheung <felixcheun...@hotmail.com>
Subject RE: HiveContext ignores ("skip.header.line.count"="1")
Date Tue, 27 Oct 2015 02:54:20 GMT
Please open a JIRA?

 
Date: Mon, 26 Oct 2015 15:32:42 +0200
Subject: HiveContext ignores ("skip.header.line.count"="1")
From: daniel.haviv@veracity-group.com
To: user@spark.apache.org

Hi,I have a csv table in Hive which is configured to skip the header row using TBLPROPERTIES("skip.header.line.count"="1").When
querying from Hive the header row is not included in the data, but when running the same query
via HiveContext I get the header row.

I made sure that HiveContext sees the skip.header.line.count setting by running "show create
table"
Any ideas?
Thank you.
Daniel 		 	   		  
Mime
View raw message