From dev-return-24022-archive-asf-public=cust-asf.ponee.io@spark.apache.org Tue Feb 13 13:01:03 2018 Return-Path: X-Original-To: archive-asf-public@eu.ponee.io Delivered-To: archive-asf-public@eu.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by mx-eu-01.ponee.io (Postfix) with ESMTP id 951D4180656 for ; Tue, 13 Feb 2018 13:01:03 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 845AE160C53; Tue, 13 Feb 2018 12:01:03 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id A19C3160C50 for ; Tue, 13 Feb 2018 13:01:02 +0100 (CET) Received: (qmail 16342 invoked by uid 500); 13 Feb 2018 12:01:01 -0000 Mailing-List: contact dev-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list dev@spark.apache.org Received: (qmail 16327 invoked by uid 99); 13 Feb 2018 12:01:00 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 13 Feb 2018 12:01:00 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 001B41A07B9 for ; Tue, 13 Feb 2018 12:01:00 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.193 X-Spam-Level: *** X-Spam-Status: No, score=3.193 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, HTML_OBFUSCATE_05_10=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, URI_HEX=1.313] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id UaAC41mB7-dY for ; Tue, 13 Feb 2018 12:00:56 +0000 (UTC) Received: from mail-it0-f46.google.com (mail-it0-f46.google.com [209.85.214.46]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 050C05F232 for ; Tue, 13 Feb 2018 12:00:56 +0000 (UTC) Received: by mail-it0-f46.google.com with SMTP id 193so7888283iti.1 for ; Tue, 13 Feb 2018 04:00:55 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=hG+HA64VN8ob/lPU85Btns2Esz5RCnWhMDbHaHsSSqg=; b=WfEROZY1XL1AtMykNZPr2nx0nZOnSxohBMNHLda3Q9xElbgBTKxAM++ERSl7qPt2ZM PLnOGgPrHVd7KGYue3Phl2eSfb3cYmOxQYI9m7jU5xlZjW2RSVETqTKk7GqrIDxiq+pj Q5+RR4Mz7xsJyWummO11SAH1Suc9/FL4wcOieoINp7dhnCk+/TzFxRZbAbY78nWZ4Wm4 HCammWBPIOWTWj44TRGliqHJ6UKRObCEZKhhgOahAC+SjU1a+Blg0cq13yD0kjQZ+jIh 5fYoD2uy23s479qiQCGN1jwLHSXoIhO7SLLTnPX9tePLa5u6M5Hs5dUO9ZThK99YbsOZ RM4g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=hG+HA64VN8ob/lPU85Btns2Esz5RCnWhMDbHaHsSSqg=; b=Pm44asF9WbMTdp2jPq1IojLzkBTthSduxM0n+HZVAfQrRgn8AnO8441dzYiDEqaDqD Q1VfTYGmp+DZtRfywplq66DKN4ZxwVOiy2lMM30nBHi9MXKpF69mxgSSeAB74lRy1+bT H6BCG5Cn1qh8ngJnRG7bfmf7m5cknV7pRKAn4H4jWYo6gwL0iRfFdeRbALn4yjmdxiuB evuhu2/cVq7xm7v6CdfvXe2DGW/xqDijzY7lR64mqjte2U5rIH7590V5bCqxhCt1IXqP VM+qGimkVwvkdAs17OhcKkoqXypfX1xSE1/YdjyukcMx/ebXEvmqmawoSEq+IFlNR6m+ 81EA== X-Gm-Message-State: APf1xPC/mtmcDzuKjLHr7h7honMKC0iBiEPB0ujYZJRyNQh4Y3s00K88 Rn7Knye+C+vw/ZhNot5lIfdIeDSIC+C0dvoc97U= X-Google-Smtp-Source: AH8x224Fs8yn0krRY4/lxGMBIPBpXcQxdSblmad5xnQkZ9NohVdO2aDQ7NFqG8xJau4NGHXU4jJ6twQjxn3B1tez5ME= X-Received: by 10.36.78.2 with SMTP id r2mr482331ita.151.1518523254842; Tue, 13 Feb 2018 04:00:54 -0800 (PST) MIME-Version: 1.0 Received: by 10.79.46.67 with HTTP; Tue, 13 Feb 2018 04:00:54 -0800 (PST) In-Reply-To: References: From: SNEHASISH DUTTA Date: Tue, 13 Feb 2018 17:30:54 +0530 Message-ID: Subject: Re: There is no space for new record To: Spark dev list Content-Type: multipart/alternative; boundary="001a1143e70a302c15056516bf04" --001a1143e70a302c15056516bf04 Content-Type: text/plain; charset="UTF-8" Hi, Will it be possible to overcome this with some spark configuration tweak , since EMR has spark version available only till 2.2.1 Regards, Snehasish On Tue, Feb 13, 2018 at 2:00 PM, Marco Gaido wrote: > You can check all the versions where the fix is available on the > JIRA SPARK-23376. Anyway it will be available in the upcoming 2.3.0 release. > > Thanks. > > On 13 Feb 2018 9:09 a.m., "SNEHASISH DUTTA" > wrote: > >> Hi, >> >> In which version of Spark will this fix be available ? >> The deployment is on EMR >> >> Regards, >> Snehasish >> >> On Fri, Feb 9, 2018 at 8:51 PM, Wenchen Fan wrote: >> >>> It should be fixed by https://github.com/apache/spark/pull/20561 soon. >>> >>> On Fri, Feb 9, 2018 at 6:16 PM, Wenchen Fan wrote: >>> >>>> This has been reported before: http://apache-spark-de >>>> velopers-list.1001551.n3.nabble.com/java-lang-IllegalStateEx >>>> ception-There-is-no-space-for-new-record-tc20108.html >>>> >>>> I think we may have a real bug here, but we need a reproduce. Can you >>>> provide one? thanks! >>>> >>>> On Fri, Feb 9, 2018 at 5:59 PM, SNEHASISH DUTTA < >>>> info.snehasish@gmail.com> wrote: >>>> >>>>> Hi , >>>>> >>>>> I am facing the following when running on EMR >>>>> >>>>> Caused by: java.lang.IllegalStateException: There is no space for new >>>>> record >>>>> at org.apache.spark.util.collecti >>>>> on.unsafe.sort.UnsafeInMemorySorter.insertRecord(UnsafeInMem >>>>> orySorter.java:226) >>>>> at org.apache.spark.sql.execution >>>>> .UnsafeKVExternalSorter.(UnsafeKVExternalSorter.java:132) >>>>> at org.apache.spark.sql.execution >>>>> .UnsafeFixedWidthAggregationMap.destructAndCreateExternalSor >>>>> ter(UnsafeFixedWidthAggregationMap.java:250) >>>>> >>>>> I am using pyspark 2.2 , what spark configuration should be >>>>> changed/modified to get this resolved >>>>> >>>>> >>>>> Regards, >>>>> Snehasish >>>>> >>>>> >>>>> Regards, >>>>> Snehasish >>>>> >>>>> On Fri, Feb 9, 2018 at 1:26 PM, SNEHASISH DUTTA < >>>>> info.snehasish@gmail.com> wrote: >>>>> >>>>>> Hi , >>>>>> >>>>>> I am facing the following when running on EMR >>>>>> >>>>>> Caused by: java.lang.IllegalStateException: There is no space for >>>>>> new record >>>>>> at org.apache.spark.util.collecti >>>>>> on.unsafe.sort.UnsafeInMemorySorter.insertRecord(UnsafeInMem >>>>>> orySorter.java:226) >>>>>> at org.apache.spark.sql.execution >>>>>> .UnsafeKVExternalSorter.(UnsafeKVExternalSorter.java:132) >>>>>> at org.apache.spark.sql.execution >>>>>> .UnsafeFixedWidthAggregationMap.destructAndCreateExternalSor >>>>>> ter(UnsafeFixedWidthAggregationMap.java:250) >>>>>> >>>>>> I am using spark 2.2 , what spark configuration should be >>>>>> changed/modified to get this resolved >>>>>> >>>>>> >>>>>> Regards, >>>>>> Snehasish >>>>>> >>>>> >>>>> >>>> >>> >> --001a1143e70a302c15056516bf04 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hi,

Will it be possible to overcome thi= s with some spark configuration tweak , since EMR has spark version availab= le only till 2.2.1

<= div class=3D"gmail_signature" data-smartmail=3D"gmail_signature">
Regards,
Snehasish

On Tue, Feb 13, 2018 at 2:00 PM, Marco Gaido= <marcogaido91@gmail.com> wrote:
You can check all the versions where the fi= x is available on the JIRA=C2=A0SPARK-23376. Anyway it will be available in= the upcoming 2.3.0 release.

T= hanks.

On 13 Feb 2018 9:09 a.m., "SN= EHASISH DUTTA" <info.snehasish@gmail.com> wrote:
Hi,

In which versio= n of Spark=20 will=C2=A0this fix=C2=A0 be available ?The deployment is on EMR

<= div>
Regards,
Snehasis= h

On Fri, Feb 9, 2018 at 8:51 PM, Wenchen Fan = <cloud0fan@gmail.com> wrote:
It should be fixed by=C2=A0https://github.com/apache/s<= wbr>park/pull/20561 soon.

On Fri, = Feb 9, 2018 at 6:16 PM, Wenchen Fan <cloud0fan@gmail.com> = wrote:
This has been rep= orted before:=C2=A0http://apache-spark-developers-list= .1001551.n3.nabble.com/java-lang-IllegalStateException-There-is-n= o-space-for-new-record-tc20108.html

I think we = may have a real bug here, but we need a reproduce. Can you provide one? tha= nks!

On Fri, Feb 9, 2018 at 5:59 PM, SNEHASISH DUTTA <= info.snehasish@gmail.com> wrote:
= Hi ,

I am facing the following when running on EMR

=
Caused by: java.lang.IllegalStateException: There is no spa= ce for new record
=C2=A0 =C2=A0 =C2=A0 =C2=A0 at org.apache.spark= .util.collection.unsafe.sort.UnsafeInMemorySorter.insertRecord(Un= safeInMemorySorter.java:226)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 at = org.apache.spark.sql.execution.UnsafeKVExternalSorter.<init>(UnsafeKVExternalSorter.java:132)
=C2=A0 =C2=A0 =C2=A0 =C2= =A0 at org.apache.spark.sql.execution.UnsafeFixedWidthAggregationMap.destructAndCreateExternalSorter(UnsafeFixedWidthAggregationMa= p.java:250)

I am using pyspark 2.2 , what spark= configuration should be changed/modified to get this resolved=C2=A0
<= div style=3D"color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.= 8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:norma= l;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;te= xt-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(= 255,255,255);text-decoration-style:initial;text-decoration-color:initial"><= br>

Regards,
Snehasish=


Regards,
Snehasish
<= div class=3D"m_1588264197060007992m_8661978123849440064m_861124902899575266= 8m_7261066744159107127h5">
On Fri, Feb 9, 2018 at 1:26 PM, SNEHASISH DU= TTA <info.snehasish@gmail.com> wrote:
Hi ,

I am= facing the following when running on EMR

Cau= sed by: java.lang.IllegalStateException: There is no space for new rec= ord
=C2=A0 =C2=A0 =C2=A0 =C2=A0 at org.apache.spark.util.collecti= on.unsafe.sort.UnsafeInMemorySorter.insertRecord(UnsafeInMem= orySorter.java:226)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 at org.apache.spa= rk.sql.execution.UnsafeKVExternalSorter.<init>(UnsafeKVExte= rnalSorter.java:132)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 at org.apac= he.spark.sql.execution.UnsafeFixedWidthAggregationMap.destructAnd= CreateExternalSorter(UnsafeFixedWidthAggregationMap.java:250)

I am using spark 2.2 , what spark configuration= should be changed/modified to get this resolved=C2=A0

=
Regards,
Snehasish





--001a1143e70a302c15056516bf04--