airflow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From twinkle sachdeva <twinkle.sachd...@gmail.com>
Subject Re: Regarding hive server2
Date Thu, 27 Oct 2016 09:01:18 GMT
Hi Maxime,

Before this setting, i was getting following exception:

 File "/home/xxx/.pyenv/versions/2.7.12/lib/python2.7/site-
packages/pyhs2/cloudera/thrift_sasl.py", line 66, in open

    message=("Could not start SASL: %s" % self.sasl.getError()))

thrift.transport.TTransport.TTransportException: Could not start SASL:
Error in sasl_client_start (-4) SASL(-4): no mechanism available: No worthy
mechs found


After using the NOSASL setting, I am getting following exception:

File "/home/xxx/.pyenv/versions/2.7.12/lib/python2.7/site-
packages/pyhs2/TCLIService/TCLIService.py", line 154, in OpenSession

    return self.recv_OpenSession()

  File "/home/xxx/.pyenv/versions/2.7.12/lib/python2.7/site-
packages/pyhs2/TCLIService/TCLIService.py", line 165, in recv_OpenSession

    (fname, mtype, rseqid) = self._iprot.readMessageBegin()

  File "/home/xxx/.pyenv/versions/2.7.12/lib/python2.7/site-
packages/thrift/protocol/TBinaryProtocol.py", line 140, in readMessageBegin

    name = self.trans.readAll(sz)

  File "/home/xxx/.pyenv/versions/2.7.12/lib/python2.7/site-
packages/thrift/transport/TTransport.py", line 58, in readAll

    chunk = self.read(sz - have)

  File "/home/xxx/.pyenv/versions/2.7.12/lib/python2.7/site-
packages/thrift/transport/TTransport.py", line 159, in read

    self.__rbuf = StringIO(self.__trans.read(max(sz, self.__rbuf_size)))

  File "/home/xxx/.pyenv/versions/2.7.12/lib/python2.7/site-
packages/thrift/transport/TSocket.py", line 118, in read

    message='TSocket read 0 bytes')

thrift.transport.TTransport.TTransportException: TSocket read 0 bytes.


I did checked, if the hive server is running or not.

I am getting the same issue, if i try to connect using simple python
program also.

On Wed, Oct 26, 2016 at 9:17 PM, Maxime Beauchemin <
maximebeauchemin@gmail.com> wrote:

> From memory, I think this is related to having the wrong authentication
> method.
> https://github.com/apache/incubator-airflow/blob/master/
> airflow/hooks/hive_hooks.py#L578
>
> You may want to try NOSASL. To do that i think you have to put something
> like `{ "authMechanism": "NOSASL" }` in your Connection's extra params.
>
> On Wed, Oct 26, 2016 at 1:50 AM, twinkle sachdeva <
> twinkle.sachdeva@gmail.com> wrote:
>
> > Hi,
> >
> > I am trying to use HiveToMySqlTransfer operator, but I am not able to
> read
> > any data with the following configuration:
> >
> > TSocket.py", line 120, in read
> >
> >     message='TSocket read 0 bytes')
> >
> > thrift.transport.TTransport.TTransportException: TSocket read 0 bytes
> >
> > It seems to happen due to some mismatch in thrift protocol etc
> > specification.
> >
> > Please help me on what can be done.
> >
> >
> > Regards,
> >
> > Twinkle
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message