spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Raymond Honderdors <Raymond.Honderd...@sizmek.com>
Subject RE: Return binary mode in ThriftServer
Date Tue, 14 Jun 2016 13:37:28 GMT
I experienced something similar using Sprak+Microstretegy
I reformatted the commands file locally and recompiled spark 2.0, for the issue was resolved,
but I am not sure I made the change in the correct direction
1.    SPARK-14947<https://issues.apache.org/jira/browse/SPARK-14947>




Raymond Honderdors
Team Lead Analytics BI
Business Intelligence Developer
raymond.honderdors@sizmek.com<mailto:raymond.honderdors@sizmek.com>
T +972.7325.3569
Herzliya

From: Chris Fregly [mailto:chris@fregly.com]
Sent: Tuesday, June 14, 2016 4:06 PM
To: Reynold Xin <rxin@databricks.com>
Cc: Egor Pahomov <pahomov.egor@gmail.com>; davies@databricks.com; dev@spark.apache.org
Subject: Re: Return binary mode in ThriftServer

+1 on bringing it back.  causing all sorts of problems on my end that was not obvious without
digging in

I was having problems building spark, as well, with the --hive-thriftserver flag.  also thought
I was doing something wrong on my end.

On Jun 13, 2016, at 9:11 PM, Reynold Xin <rxin@databricks.com<mailto:rxin@databricks.com>>
wrote:
Thanks for the email. Things like this (and bugs) are exactly the reason the preview releases
exist. It seems like enough people have run into problem with this one that maybe we should
just bring it back for backward compatibility.

On Monday, June 13, 2016, Egor Pahomov <pahomov.egor@gmail.com<mailto:pahomov.egor@gmail.com>>
wrote:
In May due to the SPARK-15095 binary mode was "removed" (code is there, but you can not turn
it on) from Spark-2.0. In 1.6.1 binary was default and in 2.0.0-preview it was removed. It's
really annoying:

  *   I can not use Tableau+Spark anymore
  *   I need to change connection URL in SQL client for every analyst in my organization.
And with Squirrel I experiencing problems with that.
  *   We have parts of infrastructure, which connected to data infrastructure though ThriftServer.
And of course format was binary.
I've created a ticket to get binary back(https://issues.apache.org/jira/browse/SPARK-15934),
but that's not the point. I've experienced this problem a month ago, but haven't done anything
about it, because I believed, that I'm stupid and doing something wrong. But documentation
was release recently and it contained no information about this new thing and it made me digging.

Most of what I describe is just annoying, but Tableau+Spark new incompatibility I believe
is big deal. Maybe I'm wrong and there are ways to make things work, it's just I wouldn't
expect move to 2.0.0 to be so time consuming.

My point: Do we have any guidelines regarding doing such radical things?

--
Sincerely yours
Egor Pakhomov

Mime
View raw message