spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Lionel PERRIN <lionel_per...@hotmail.com>
Subject Init/Setup worker
Date Tue, 10 May 2016 14:37:09 GMT
Hello,

 

I’m looking for a solution to use jruby on top of spark. The only tricky point is that I
need that every worker thread has a ruby interpreter initialized.
Basically, I need to register a function to be called when each worker thread
is created : a thread local variable must be set for the ruby interpreter so
that ruby object can be deserialized.

 

Is there any solution to setup the worker threads before any
spark call is made using this thread ?
Regards,
Lionel 		 	   		  
Mime
View raw message