spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: Multiple drivers, same worker
Date Wed, 09 Dec 2015 20:19:08 GMT
When this happened, did you have a chance to take jstack of the stuck
driver process ?

Thanks

On Wed, Dec 9, 2015 at 11:38 AM, andresbm84@gmail.com <andresbm84@gmail.com>
wrote:

> Forgot to mention that it doesn't happen every time, it's pretty random so
> far. We've have complete days when it behaves just fine and others when it
> gets crazy. We're using spark 1.5.2
>
> 2015-12-09 13:33 GMT-06:00 andresbm84@gmail.com <andresbm84@gmail.com>:
>
>> Hi everyone,
>>
>> We've been getting an issue with spark lately where multiple drivers are
>> assigned to a same worker but resources are never assigned to them and get
>> "stuck" forever.
>>
>> If I login in the worker machine I see that the driver processes aren't
>> really running and the worker's log don't show any error or anything
>> related to the driver. The master UI does show the drivers as submitted and
>> in RUNNING state.
>>
>>
>> Not sure where else to look for clues, any ideas?
>>
>> --
>> Andrés Blanco Morales
>>
>
>
>
> --
> Andrés Blanco Morales
>

Mime
View raw message