pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "liyunzhang_intel (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (PIG-5044) Create SparlCompiler#getSamplingJob in spark mode
Date Tue, 18 Oct 2016 17:11:58 GMT

    [ https://issues.apache.org/jira/browse/PIG-5044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15585999#comment-15585999
] 

liyunzhang_intel edited comment on PIG-5044 at 10/18/16 5:11 PM:
-----------------------------------------------------------------

[~kexianda]:  try to use PIG-5044.patch in Skewed Join  optimization(PIG-4858) and help review.


was (Author: kellyzly):
[~kexianda]:  Help review PIG-5044.patch

> Create SparlCompiler#getSamplingJob in spark mode
> -------------------------------------------------
>
>                 Key: PIG-5044
>                 URL: https://issues.apache.org/jira/browse/PIG-5044
>             Project: Pig
>          Issue Type: Sub-task
>          Components: spark
>            Reporter: liyunzhang_intel
>            Assignee: liyunzhang_intel
>             Fix For: spark-branch
>
>         Attachments: PIG-5044.patch
>
>
> Like MRCompiler#getSamplingJob, we also need a function like that to sample data from
a file, sort sampling data  and generate output by UDF(org.apache.pig.impl.builtin.FindQuantiles).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message