pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "liyunzhang_intel (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PIG-4168) Initial implementation of unit tests for Pig on Spark
Date Tue, 23 Sep 2014 02:31:34 GMT

    [ https://issues.apache.org/jira/browse/PIG-4168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14144215#comment-14144215
] 

liyunzhang_intel commented on PIG-4168:
---------------------------------------

submit first PIG-4168.patch. The patch contains most unit test case except CACHE UDF

> Initial implementation of unit tests for Pig on Spark
> -----------------------------------------------------
>
>                 Key: PIG-4168
>                 URL: https://issues.apache.org/jira/browse/PIG-4168
>             Project: Pig
>          Issue Type: Sub-task
>          Components: spark
>            Reporter: Praveen Rachabattuni
>            Assignee: liyunzhang_intel
>         Attachments: PIG-4168.patch
>
>
> 1.ant clean jar;  pig-0.14.0-SNAPSHOT-core-h1.jar will be generated by the command
> 2.export SPARK_PIG_JAR=$PIG_HOME/pig-0.14.0-SNAPSHOT-core-h1.jar 
> 3.build hadoop1 and spark env.spark run in local mode
>   jps:
> 	11647 Master #spark master runs
> 	6457 DataNode #hadoop datanode runs
> 	22374 Jps
> 	11705 Worker# spark worker runs
> 	27009 JobTracker #hadoop jobtracker runs
> 	26602 NameNode  #hadoop namenode runs
> 	29486 org.eclipse.equinox.launcher_1.3.0.v20120522-1813.jar
> 	19692 Main
>  
> 4.ant test-spark



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message