arrow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From u..@apache.org
Subject arrow git commit: ARROW-941: Add "cold start" instructions for running integration tests
Date Thu, 07 Sep 2017 16:42:50 GMT
Repository: arrow
Updated Branches:
  refs/heads/master 6e5f7be10 -> a9a80fef7


ARROW-941: Add "cold start" instructions for running integration tests

This is helpful for users who do not regularly use Python.

Author: Wes McKinney <wes.mckinney@twosigma.com>

Closes #1061 from wesm/ARROW-941 and squashes the following commits:

5f18cd7 [Wes McKinney] Add environment setup instruction for integration tests for users without
any Python environment already


Project: http://git-wip-us.apache.org/repos/asf/arrow/repo
Commit: http://git-wip-us.apache.org/repos/asf/arrow/commit/a9a80fef
Tree: http://git-wip-us.apache.org/repos/asf/arrow/tree/a9a80fef
Diff: http://git-wip-us.apache.org/repos/asf/arrow/diff/a9a80fef

Branch: refs/heads/master
Commit: a9a80fef7f930ac7141f3c02f2b1dfbb98dfdd1d
Parents: 6e5f7be
Author: Wes McKinney <wes.mckinney@twosigma.com>
Authored: Thu Sep 7 18:40:48 2017 +0200
Committer: Uwe L. Korn <uwelk@xhochy.com>
Committed: Thu Sep 7 18:40:48 2017 +0200

----------------------------------------------------------------------
 integration/README.md | 31 +++++++++++++++++++++++++++++--
 1 file changed, 29 insertions(+), 2 deletions(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/arrow/blob/a9a80fef/integration/README.md
----------------------------------------------------------------------
diff --git a/integration/README.md b/integration/README.md
index 5b6ea45..6e5a6c1 100644
--- a/integration/README.md
+++ b/integration/README.md
@@ -30,6 +30,31 @@ Our strategy for integration testing between Arrow implementations is as
follows
 * The test executable is also capable of validating the contents of a binary
   file against a corresponding JSON file
 
+## Environment setup
+
+The integration test data generator and runner is written in Python and
+currently requires Python 3.5 or higher. You can create a standalone Python
+distribution and environment for running the tests by using [miniconda][1]. On
+Linux this is:
+
+```shell
+MINICONDA_URL=https://repo.continuum.io/miniconda/Miniconda3-latest-Linux-x86_64.sh
+wget -O miniconda.sh $MINICONDA_URL
+bash miniconda.sh -b -p miniconda
+export PATH=`pwd`/miniconda/bin:$PATH
+
+conda create -n arrow-integration python=3.6 nomkl numpy six
+source activate arrow-integration
+```
+
+If you are on macOS, instead use the URL:
+
+```shell
+MINICONDA_URL=https://repo.continuum.io/miniconda/Miniconda3-latest-MacOSX-x86_64.sh
+```
+
+After this, you can follow the instructions in the next section.
+
 ## Running the existing integration tests
 
 First, build the Java and C++ projects. For Java, you must run
@@ -43,7 +68,7 @@ Java `arrow-tool` JAR and the build path for the C++ executables:
 
 ```bash
 JAVA_DIR=$ARROW_HOME/java
-CPP_BUILD_DIR=$ARROW_HOME/cpp/test-build
+CPP_BUILD_DIR=$ARROW_HOME/cpp/build
 
 VERSION=0.1.1-SNAPSHOT
 export ARROW_JAVA_INTEGRATION_JAR=$JAVA_DIR/tools/target/arrow-tools-$VERSION-jar-with-dependencies.jar
@@ -61,4 +86,6 @@ for additional output)
 python integration_test.py
 
 python integration_test.py --debug  # additional output
-```
\ No newline at end of file
+```
+
+[1]: https://conda.io/miniconda.html
\ No newline at end of file


Mime
View raw message