pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dmitriy Ryaboy <dvrya...@gmail.com>
Subject Re: Turn off Speculative Execution in a UDF?
Date Fri, 02 Mar 2012 21:45:57 GMT
In a StoreFunc, you could do that when you get passed the jobconf, right?

On Thu, Mar 1, 2012 at 9:37 PM, Bill Graham <billgraham@gmail.com> wrote:
> I don't think so. We just do it in the pig script before using the store
> func:
>
> SET mapred.map.tasks.speculative.execution false
>
>
> On Thu, Mar 1, 2012 at 4:19 PM, Russell Jurney <russell.jurney@gmail.com>wrote:
>
>> Can you turn off speculative execution in a StoreFunc?  I believe it is
>> leading to duplicates in MongoStorage();
>>
>> --
>> Russell Jurney twitter.com/rjurney russell.jurney@gmail.com
>> datasyndrome.com
>>
>
>
>
> --
> *Note that I'm no longer using my Yahoo! email address. Please email me at
> billgraham@gmail.com going forward.*

Mime
View raw message