spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Owen (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SPARK-6985) Receiver maxRate over 1000 causes a StackOverflowError
Date Mon, 20 Apr 2015 17:44:58 GMT

     [ https://issues.apache.org/jira/browse/SPARK-6985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Sean Owen updated SPARK-6985:
-----------------------------
    Priority: Critical  (was: Major)

Re: Priority, don't worry in the sense that this should definitely be committed shortly. I
was just waiting on the trivial style fix. 

Priority is not used consistently much here, though as an aside, I was hoping to fix that
a bit with the update to our "Contributing" wiki. Priority unfortunately conflates "what is
most important to work on", "when does this have to be fixed by", "how big is the impact"
and "how hard is it to fix". It's certainly going to be fixed for the next release so is it
a "Blocker"? it's easyish to fix so is it "Minor"? Let's say Critical!

> Receiver maxRate over 1000 causes a StackOverflowError
> ------------------------------------------------------
>
>                 Key: SPARK-6985
>                 URL: https://issues.apache.org/jira/browse/SPARK-6985
>             Project: Spark
>          Issue Type: Bug
>          Components: Streaming
>    Affects Versions: 1.3.0
>            Reporter: David McGuire
>            Priority: Critical
>
> Attempting to set the streaming receiver max rate (streaming.receiverMaxRate) for the
RateLimiter to anything over 1000 causes a fatal error in the receiver with the following
stacktrace:
> 15/04/16 10:41:50 ERROR KafkaReceiver: Error handling message; exiting
> java.lang.StackOverflowError
> 	at org.apache.spark.streaming.receiver.RateLimiter.waitToPush(RateLimiter.scala:66)
> 	at org.apache.spark.streaming.receiver.RateLimiter.waitToPush(RateLimiter.scala:66)
> 	at org.apache.spark.streaming.receiver.RateLimiter.waitToPush(RateLimiter.scala:66)
> 	at org.apache.spark.streaming.receiver.RateLimiter.waitToPush(RateLimiter.scala:66)
> 	at org.apache.spark.streaming.receiver.RateLimiter.waitToPush(RateLimiter.scala:66)
> 	at org.apache.spark.streaming.receiver.RateLimiter.waitToPush(RateLimiter.scala:66)
> 	at org.apache.spark.streaming.receiver.RateLimiter.waitToPush(RateLimiter.scala:66)
> 	at org.apache.spark.streaming.receiver.RateLimiter.waitToPush(RateLimiter.scala:66)
> 	at org.apache.spark.streaming.receiver.RateLimiter.waitToPush(RateLimiter.scala:66)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message