spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: KinesisStreamSuite failing in master branch
Date Mon, 20 Jul 2015 14:28:56 GMT
TD:
Thanks for getting the builds back to green.

On Sun, Jul 19, 2015 at 7:21 PM, Tathagata Das <tdas@databricks.com> wrote:

> The PR to fix this is out.
> https://github.com/apache/spark/pull/7519
>
>
> On Sun, Jul 19, 2015 at 6:41 PM, Tathagata Das <tdas@databricks.com>
> wrote:
>
>> I am taking care of this right now.
>>
>> On Sun, Jul 19, 2015 at 6:08 PM, Patrick Wendell <pwendell@gmail.com>
>> wrote:
>>
>>> I think we should just revert this patch on all affected branches. No
>>> reason to leave the builds broken until a fix is in place.
>>>
>>> - Patrick
>>>
>>> On Sun, Jul 19, 2015 at 6:03 PM, Josh Rosen <rosenville@gmail.com>
>>> wrote:
>>> > Yep, I emailed TD about it; I think that we may need to make a change
>>> to the
>>> > pull request builder to fix this.  Pending that, we could just revert
>>> the
>>> > commit that added this.
>>> >
>>> > On Sun, Jul 19, 2015 at 5:32 PM, Ted Yu <yuzhihong@gmail.com> wrote:
>>> >>
>>> >> Hi,
>>> >> I noticed that KinesisStreamSuite fails for both hadoop profiles in
>>> master
>>> >> Jenkins builds.
>>> >>
>>> >> From
>>> >>
>>> https://amplab.cs.berkeley.edu/jenkins/job/Spark-Master-Maven-with-YARN/HADOOP_PROFILE=hadoop-2.4,label=centos/3011/console
>>> >> :
>>> >>
>>> >> KinesisStreamSuite:
>>> >> *** RUN ABORTED ***
>>> >>   java.lang.AssertionError: assertion failed: Kinesis test not
>>> enabled,
>>> >> should not attempt to get AWS credentials
>>> >>   at scala.Predef$.assert(Predef.scala:179)
>>> >>   at
>>> >>
>>> org.apache.spark.streaming.kinesis.KinesisTestUtils$.getAWSCredentials(KinesisTestUtils.scala:189)
>>> >>   at
>>> >> org.apache.spark.streaming.kinesis.KinesisTestUtils.org
>>> $apache$spark$streaming$kinesis$KinesisTestUtils$$kinesisClient$lzycompute(KinesisTestUtils.scala:59)
>>> >>   at
>>> >> org.apache.spark.streaming.kinesis.KinesisTestUtils.org
>>> $apache$spark$streaming$kinesis$KinesisTestUtils$$kinesisClient(KinesisTestUtils.scala:58)
>>> >>   at
>>> >>
>>> org.apache.spark.streaming.kinesis.KinesisTestUtils.describeStream(KinesisTestUtils.scala:121)
>>> >>   at
>>> >>
>>> org.apache.spark.streaming.kinesis.KinesisTestUtils.findNonExistentStreamName(KinesisTestUtils.scala:157)
>>> >>   at
>>> >>
>>> org.apache.spark.streaming.kinesis.KinesisTestUtils.createStream(KinesisTestUtils.scala:78)
>>> >>   at
>>> >>
>>> org.apache.spark.streaming.kinesis.KinesisStreamSuite.beforeAll(KinesisStreamSuite.scala:45)
>>> >>   at
>>> >>
>>> org.scalatest.BeforeAndAfterAll$class.beforeAll(BeforeAndAfterAll.scala:187)
>>> >>   at
>>> >>
>>> org.apache.spark.streaming.kinesis.KinesisStreamSuite.beforeAll(KinesisStreamSuite.scala:33)
>>> >>
>>> >>
>>> >> FYI
>>> >
>>> >
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
>>> For additional commands, e-mail: dev-help@spark.apache.org
>>>
>>>
>>
>

Mime
View raw message