Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2FD9218F8F for ; Fri, 14 Aug 2015 17:39:55 +0000 (UTC) Received: (qmail 33379 invoked by uid 500); 14 Aug 2015 17:39:52 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 33336 invoked by uid 500); 14 Aug 2015 17:39:52 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 33326 invoked by uid 99); 14 Aug 2015 17:39:52 -0000 Received: from Unknown (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 14 Aug 2015 17:39:52 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id D65D9DDDFE for ; Fri, 14 Aug 2015 17:39:51 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.879 X-Spam-Level: ** X-Spam-Status: No, score=2.879 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=3, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-us-west.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id rshrBY1KmHSi for ; Fri, 14 Aug 2015 17:39:51 +0000 (UTC) Received: from mail-ig0-f174.google.com (mail-ig0-f174.google.com [209.85.213.174]) by mx1-us-west.apache.org (ASF Mail Server at mx1-us-west.apache.org) with ESMTPS id E52562055B for ; Fri, 14 Aug 2015 17:39:50 +0000 (UTC) Received: by igui7 with SMTP id i7so17473955igu.1 for ; Fri, 14 Aug 2015 10:39:50 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=11w/NtK32UhjaBTEj02VI897aTyENOgSSdp2pQr7M4s=; b=B09g87OseHZzVoh+nwR4xP5Ah9sWeYHijs5njoGoZhCp59P3O8godCiw+lej2ip90q NWJ988Grl7qnVWvQXSbavT0+VjGpDSm9o2x/0qPuMV3Z2uC1SOa+DnE1CqpsYvg4rgEq d5W42Sncxd1Qd8TACoLFIhFL8jYgvaH64k6HoXA1xA8JvTdLDAmI5UJe5LJVyrXoEXd2 Om32krATheWEb66IeknOBvCqFjGQL0aCmNFX9fFJLW4n7vFiwWoSSMBPVNVoagC2GzRG YrHEuKL0K/j9ZZRBlrQ8W1Vg7VfgEdGSQxpwhdfHy3YIkmw1amvbTFJJ411q7eep4rEP nNXw== MIME-Version: 1.0 X-Received: by 10.50.112.231 with SMTP id it7mr3778241igb.45.1439573990382; Fri, 14 Aug 2015 10:39:50 -0700 (PDT) Received: by 10.64.19.73 with HTTP; Fri, 14 Aug 2015 10:39:50 -0700 (PDT) In-Reply-To: <1613568061.2974334.1439569672904.JavaMail.yahoo@mail.yahoo.com> References: <1613568061.2974334.1439569672904.JavaMail.yahoo@mail.yahoo.com> Date: Fri, 14 Aug 2015 18:39:50 +0100 Message-ID: Subject: Re: sstableloader in version 2.0.14 doesn't honor thrift_framed_transport_size_in_mb set on server side From: Prem Yadav To: "user@cassandra.apache.org" , K F Content-Type: multipart/alternative; boundary=089e0118417c532554051d48f07d --089e0118417c532554051d48f07d Content-Type: text/plain; charset=UTF-8 We had this issue when using hive on cassandra. We had to replace the thrift jar with our own patches. On Fri, Aug 14, 2015 at 5:27 PM, K F wrote: > While using sstableloader in 2.0.14 we have discovered that setting > the thrift_framed_transport_size_in_mb to 16 in cassandra.yaml doesn't > honor it. Did anybody see similar issue? > > So, this is the exception seen, > > org.apache.thrift.transport.TTransportException: Frame size (16165888) > larger than max length (15728640)! > java.lang.RuntimeException: Could not retrieve endpoint ranges: > at > org.apache.cassandra.tools.BulkLoader$ExternalClient.init(BulkLoader.java:282) > at > org.apache.cassandra.io.sstable.SSTableLoader.stream(SSTableLoader.java:149) > at org.apache.cassandra.tools.BulkLoader.main(BulkLoader.java:94) > Caused by: org.apache.thrift.transport.TTransportException: Frame size > (16165888) larger than max length (15728640)! > at > org.apache.thrift.transport.TFramedTransport.readFrame(TFramedTransport.java:137) > at > org.apache.thrift.transport.TFramedTransport.read(TFramedTransport.java:101) > at > org.apache.thrift.transport.TTransport.readAll(TTransport.java:84) > at > org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:362) > at > org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:284) > at > org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:191) > at > org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:69) > at > org.apache.cassandra.thrift.Cassandra$Client.recv_describe_ring(Cassandra.java:1251) > at > org.apache.cassandra.thrift.Cassandra$Client.describe_ring(Cassandra.java:1238) > at > org.apache.cassandra.tools.BulkLoader$ExternalClient.init(BulkLoader.java:258) > ... 2 more > > On Server side, it's the following. > > 2015-08-14 15:10:10,637 [main] INFO ThriftServer Using TFramedTransport > with a max frame size of 16777216 bytes. > > --089e0118417c532554051d48f07d Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
We had this issue when using hive on cassandra.
We had= to replace the thrift jar with our own patches.

On Fri, Aug 14, 2015 at 5:27 PM,= K F <kf200467@yahoo.com> wrote:
While using ssta= bleloader in 2.0.14 we have discovered that setting the=C2=A0thrift_framed_= transport_size_in_mb to 16 in cassandra.yaml doesn't honor it. Did anyb= ody see similar issue?

So,= this is the exception seen,

org.apache.thrift.transport.TTransportException: Frame size (16165888) l= arger than max length (15728640)!
java.lang.RuntimeEx= ception: Could not retrieve endpoint ranges:=C2=A0
= =C2=A0 =C2=A0 =C2=A0 =C2=A0 at org.apache.cassandra.tools.BulkLoader$Extern= alClient.init(BulkLoader.java:282)
=C2=A0 =C2=A0 =C2= =A0 =C2=A0 at org.apache.cassandra.io.sstable.SSTableLoader.stream(SSTableL= oader.java:149)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 at org.ap= ache.cassandra.tools.BulkLoader.main(BulkLoader.java:94)
Caused by: org.apache.thrift.transport.TTransportException: Frame size = (16165888) larger than max length (15728640)!
=C2=A0 = =C2=A0 =C2=A0 =C2=A0 at org.apache.thrift.transport.TFramedTransport.readFr= ame(TFramedTransport.java:137)
=C2=A0 =C2=A0 =C2=A0 = =C2=A0 at org.apache.thrift.transport.TFramedTransport.read(TFramedTranspor= t.java:101)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 at org.apache= .thrift.transport.TTransport.readAll(TTransport.java:84)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 at org.apache.thrift.protocol.TBinaryProtoc= ol.readAll(TBinaryProtocol.java:362)
=C2=A0 =C2=A0 = =C2=A0 =C2=A0 at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinary= Protocol.java:284)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 at org= .apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.ja= va:191)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 at org.apache.thr= ift.TServiceClient.receiveBase(TServiceClient.java:69)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 at org.apache.cassandra.thrift.Cassandra$Clie= nt.recv_describe_ring(Cassandra.java:1251)
=C2=A0 =C2= =A0 =C2=A0 =C2=A0 at org.apache.cassandra.thrift.Cassandra$Client.describe_= ring(Cassandra.java:1238)
=C2=A0 =C2=A0 =C2=A0 =C2=A0= at org.apache.cassandra.tools.BulkLoader$ExternalClient.init(BulkLoader.ja= va:258)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 ... 2 more
<= div dir=3D"ltr">
On Server side, it's the fol= lowing.

2= 015-08-14 15:10:10,637 [main] INFO ThriftServer Using TFramedTransport with= a max frame size of 16777216 bytes.

=

--089e0118417c532554051d48f07d--