Return-Path: X-Original-To: apmail-tinkerpop-commits-archive@minotaur.apache.org Delivered-To: apmail-tinkerpop-commits-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D433519C7E for ; Mon, 11 Apr 2016 18:10:32 +0000 (UTC) Received: (qmail 7565 invoked by uid 500); 11 Apr 2016 18:10:32 -0000 Delivered-To: apmail-tinkerpop-commits-archive@tinkerpop.apache.org Received: (qmail 7544 invoked by uid 500); 11 Apr 2016 18:10:32 -0000 Mailing-List: contact commits-help@tinkerpop.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@tinkerpop.incubator.apache.org Delivered-To: mailing list commits@tinkerpop.incubator.apache.org Received: (qmail 7534 invoked by uid 99); 11 Apr 2016 18:10:32 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 11 Apr 2016 18:10:32 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 5E426C1403 for ; Mon, 11 Apr 2016 18:10:32 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -4.216 X-Spam-Level: X-Spam-Status: No, score=-4.216 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.996] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id o6P2oitNngZ7 for ; Mon, 11 Apr 2016 18:10:31 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with SMTP id 69A5160F77 for ; Mon, 11 Apr 2016 18:10:30 +0000 (UTC) Received: (qmail 7147 invoked by uid 99); 11 Apr 2016 18:10:29 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 11 Apr 2016 18:10:29 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id C61C2E0329; Mon, 11 Apr 2016 18:10:28 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: dkuppitz@apache.org To: commits@tinkerpop.incubator.apache.org Date: Mon, 11 Apr 2016 18:10:31 -0000 Message-Id: <72c7148d8acf41ee8f7081b7e47b36f5@git.apache.org> In-Reply-To: <785801ddeb874b3190a31573297653bb@git.apache.org> References: <785801ddeb874b3190a31573297653bb@git.apache.org> X-Mailer: ASF-Git Admin Mailer Subject: [04/16] incubator-tinkerpop git commit: added a note about HADOOP_CONF_DIR and updated CHANGELOG from something yesterday. CTR. added a note about HADOOP_CONF_DIR and updated CHANGELOG from something yesterday. CTR. Project: http://git-wip-us.apache.org/repos/asf/incubator-tinkerpop/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-tinkerpop/commit/913598ce Tree: http://git-wip-us.apache.org/repos/asf/incubator-tinkerpop/tree/913598ce Diff: http://git-wip-us.apache.org/repos/asf/incubator-tinkerpop/diff/913598ce Branch: refs/heads/TINKERPOP-1020 Commit: 913598cee240e8e8128d5bb9d0a412e04829a43a Parents: b195b62 Author: Marko A. Rodriguez Authored: Thu Apr 7 08:14:38 2016 -0600 Committer: Marko A. Rodriguez Committed: Thu Apr 7 08:14:38 2016 -0600 ---------------------------------------------------------------------- CHANGELOG.asciidoc | 1 + .../reference/implementations-hadoop.asciidoc | 31 ++++++++++++++------ 2 files changed, 23 insertions(+), 9 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/incubator-tinkerpop/blob/913598ce/CHANGELOG.asciidoc ---------------------------------------------------------------------- diff --git a/CHANGELOG.asciidoc b/CHANGELOG.asciidoc index f90e71f..58ac67a 100644 --- a/CHANGELOG.asciidoc +++ b/CHANGELOG.asciidoc @@ -26,6 +26,7 @@ image::https://raw.githubusercontent.com/apache/incubator-tinkerpop/master/docs/ TinkerPop 3.1.2 (NOT OFFICIALLY RELEASED YET) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ +* Fixed two `NullPointerException`-potential situations in `ObjectWritable`. * Provided Docker script that allows the execution of several build tasks within a Docker container. * Added a per-request `scriptEvaluationTimeout` option to the Gremlin Server protocol. * Changed `DriverRemoteAcceptor` to send scripts as multi-line. http://git-wip-us.apache.org/repos/asf/incubator-tinkerpop/blob/913598ce/docs/src/reference/implementations-hadoop.asciidoc ---------------------------------------------------------------------- diff --git a/docs/src/reference/implementations-hadoop.asciidoc b/docs/src/reference/implementations-hadoop.asciidoc index 4a4d4d8..41b003d 100644 --- a/docs/src/reference/implementations-hadoop.asciidoc +++ b/docs/src/reference/implementations-hadoop.asciidoc @@ -42,15 +42,6 @@ familiarize their self with Giraph (link:http://giraph.apache.org/quick_start.ht Installing Hadoop-Gremlin ~~~~~~~~~~~~~~~~~~~~~~~~~ -The `HADOOP_GREMLIN_LIBS` references locations that contains jars that should be uploaded to a respective -distributed cache (link:http://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/YARN.html[YARN] or SparkServer). -Note that the locations in `HADOOP_GREMLIN_LIBS` can be a colon-separated (`:`) and all jars from all locations will -be loaded into the cluster. Typically, only the jars of the respective GraphComputer are required to be loaded (e.g. -`GiraphGraphComputer` plugin lib directory). - -[source,shell] -export HADOOP_GREMLIN_LIBS=/usr/local/gremlin-console/ext/giraph-gremlin/lib - If using <>, it is important to install the Hadoop-Gremlin plugin. Note that Hadoop-Gremlin requires a Gremlin Console restart after installing. @@ -80,6 +71,28 @@ gremlin> :plugin use tinkerpop.hadoop gremlin> ---- +It is important that the `CLASSPATH` environmental variable references `HADOOP_CONF_DIR` and that the configuration +files in `HADOOP_CONF_DIR` contain references to a live Hadoop cluster. It is easy to verify a proper configuration +from within the Gremlin Console. If `hdfs` references the local file system, then there is a configuration issue. + +[source,text] +---- +gremlin> hdfs +==>storage[org.apache.hadoop.fs.LocalFileSystem@65bb9029] // BAD + +gremlin> hdfs +==>storage[DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1229457199_1, ugi=user (auth:SIMPLE)]]] // GOOD +---- + +The `HADOOP_GREMLIN_LIBS` references locations that contains jars that should be uploaded to a respective +distributed cache (link:http://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/YARN.html[YARN] or SparkServer). +Note that the locations in `HADOOP_GREMLIN_LIBS` can be a colon-separated (`:`) and all jars from all locations will +be loaded into the cluster. Typically, only the jars of the respective GraphComputer are required to be loaded (e.g. +`GiraphGraphComputer` plugin lib directory). + +[source,shell] +export HADOOP_GREMLIN_LIBS=/usr/local/gremlin-console/ext/giraph-gremlin/lib + Properties Files ~~~~~~~~~~~~~~~~