Return-Path: X-Original-To: apmail-spark-dev-archive@minotaur.apache.org Delivered-To: apmail-spark-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 650B317B60 for ; Sat, 25 Jul 2015 15:45:11 +0000 (UTC) Received: (qmail 51629 invoked by uid 500); 25 Jul 2015 15:45:09 -0000 Delivered-To: apmail-spark-dev-archive@spark.apache.org Received: (qmail 51549 invoked by uid 500); 25 Jul 2015 15:45:09 -0000 Mailing-List: contact dev-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list dev@spark.apache.org Received: (qmail 51528 invoked by uid 99); 25 Jul 2015 15:45:09 -0000 Received: from Unknown (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 25 Jul 2015 15:45:09 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id A5623C13C2 for ; Sat, 25 Jul 2015 15:45:08 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.901 X-Spam-Level: ** X-Spam-Status: No, score=2.901 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=3, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-us-west.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id g4eHnwhrEWY2 for ; Sat, 25 Jul 2015 15:44:55 +0000 (UTC) Received: from mail-vn0-f46.google.com (mail-vn0-f46.google.com [209.85.216.46]) by mx1-us-west.apache.org (ASF Mail Server at mx1-us-west.apache.org) with ESMTPS id 67CA323133 for ; Sat, 25 Jul 2015 15:44:55 +0000 (UTC) Received: by vnaa140 with SMTP id a140so18272729vna.2 for ; Sat, 25 Jul 2015 08:44:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=o/okiZUenrepf4dFnm1M7/kOjwjfZL0VXHS8U4xd8Fc=; b=GBulAeOJGxracOGY0kfCl1aV8VDyAOERj2mFiZ4gMXeYBZ2cI4llwO0UDGY9zRyfIU XJfjeqsF/ASHR4HmzDZY19Fiw0OYThhLTeydN49fKp76YLxOGnb9RVV8Pv9DA1Z9LPte hs9QwrmP4RkXRG5q/tPWMTjANLh/Udtsl42u5JTo0pQ2RaJHCfw9mreFBhN2ipR+YVSB Q25SVAOHH44kOl7dTOOXMfpod5yPtnYiS7yuhuJFMUXbdmNMlr/XUKaLKX6EUgTB0TPo X4T538KIVc0nBhH+r53gQsoaCfixuGvygNJxXTuCvnsHdUiJQJ6qfN8B6oM5PXBMy4Ja Ijow== MIME-Version: 1.0 X-Received: by 10.52.52.114 with SMTP id s18mr25146272vdo.9.1437839088533; Sat, 25 Jul 2015 08:44:48 -0700 (PDT) Received: by 10.31.56.207 with HTTP; Sat, 25 Jul 2015 08:44:48 -0700 (PDT) In-Reply-To: References: Date: Sat, 25 Jul 2015 23:44:48 +0800 Message-ID: Subject: Re: jenkins failing on Kinesis shard limits From: Shixiong Zhu To: Patrick Wendell Cc: Steve Loughran , "dev@spark.apache.org" , "Prabeesh K." Content-Type: multipart/alternative; boundary=089e0111d57c1dc61c051bb50060 --089e0111d57c1dc61c051bb50060 Content-Type: text/plain; charset=UTF-8 The issue is in KinesisBackedBlockRDDSuite I have sent https://github.com/apache/spark/pull/7661 to remove the streams created by KinesisBackedBlockRDDSuite and https://github.com/apache/spark/pull/7663 to fix the issue. Best Regards, Shixiong Zhu 2015-07-25 14:46 GMT+08:00 Prabeesh K. : > For me > > > https://amplab.cs.berkeley.edu/jenkins/job/SlowSparkPullRequestBuilder/97/console > > > https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/38417/console > > On 25 July 2015 at 09:57, Patrick Wendell wrote: > >> I've disabled the test and filed a JIRA: >> >> https://issues.apache.org/jira/browse/SPARK-9335 >> >> On Fri, Jul 24, 2015 at 4:05 PM, Steve Loughran >> wrote: >> > >> > Looks like Jenkins is hitting some AWS limits >> > >> > >> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/38396/testReport/org.apache.spark.streaming.kinesis/KinesisBackedBlockRDDSuite/_It_is_not_a_test_/ >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org >> For additional commands, e-mail: dev-help@spark.apache.org >> >> > --089e0111d57c1dc61c051bb50060 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
The issue is in=C2=A0KinesisBackedBlockRDDSuite
=

I have sent=C2=A0https://github.com/apache/spark/pull/7661 to remove the stre= ams created by KinesisBackedBlockRDDSuite and=C2=A0https://github.com/apache/spark/pull/7663= to fix the issue.

<= div class=3D"gmail_signature">
<= div dir=3D"ltr">

Best Regards,

Shixiong Zhu=

2015-07-25 14:46 GMT+08:00 Prabeesh K. <= prabsmails@gmail.com>:
For me=C2=A0


On 25 July 2015 at 09:57, Patrick Wendell <p= wendell@gmail.com> wrote:
I've disabled the test and filed a JIRA:

https://issues.apache.org/jira/browse/SPARK-9= 335

On Fri, Jul 24, 2015 at 4:05 PM, Steve Loughran <stevel@hortonworks.com> wrote:<= br> >
> Looks like Jenkins is hitting some AWS limits
>
 > https= ://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/38396/testRep= ort/org.apache.spark.streaming.kinesis/KinesisBackedBlockRDDSuite/_It_is_no= t_a_test_/

--------------------------------------------------------------------= -
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org



--089e0111d57c1dc61c051bb50060--