pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xuefu Zhang" <xzh...@cloudera.com>
Subject Re: Review Request 38352: Enable Pig on Spark to run on Yarn Client mode
Date Wed, 16 Sep 2015 14:58:38 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38352/#review99223
-----------------------------------------------------------

Ship it!


Ship It!

- Xuefu Zhang


On Sept. 16, 2015, 12:06 p.m., Srikanth Sundarrajan wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/38352/
> -----------------------------------------------------------
> 
> (Updated Sept. 16, 2015, 12:06 p.m.)
> 
> 
> Review request for pig.
> 
> 
> Bugs: PIG-4667
>     https://issues.apache.org/jira/browse/PIG-4667
> 
> 
> Repository: pig-git
> 
> 
> Description
> -------
> 
> Enable Pig on Spark to run on Yarn Client mode
> 
> 
> Diffs
> -----
> 
>   bin/pig 15341d1 
>   build.xml b17b0e1 
>   ivy.xml 2ebebdc 
>   ivy/libraries.properties 4d1f61e 
>   src/docs/src/documentation/content/xdocs/start.xml 97d3a4d 
> 
> Diff: https://reviews.apache.org/r/38352/diff/
> 
> 
> Testing
> -------
> 
> Script used for testing
> A = LOAD '/tmp/x' USING PigStorage('\t') AS (line);
> STORE A INTO '/tmp/y' USING PigStorage(',');
> 
> Used the following environment setting before launching the script.
> declare -x HADOOP_CONF_DIR="/opt/hadoop-2.6.0.2.2.0.0-2041/etc/hadoop/"
> declare -x HADOOP_HOME="/opt/hadoop-2.6.0.2.2.0.0-2041/"
> declare -x SPARK_MASTER="yarn-client"
> 
> 
> Thanks,
> 
> Srikanth Sundarrajan
> 
>


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message