Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 8FFFD200D15 for ; Thu, 21 Sep 2017 03:14:46 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 8EA8E1609E3; Thu, 21 Sep 2017 01:14:46 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 7F4AC1609E2 for ; Thu, 21 Sep 2017 03:14:44 +0200 (CEST) Received: (qmail 96048 invoked by uid 500); 21 Sep 2017 01:14:43 -0000 Mailing-List: contact user-help@predictionio.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@predictionio.incubator.apache.org Delivered-To: mailing list user@predictionio.incubator.apache.org Received: (qmail 96031 invoked by uid 99); 21 Sep 2017 01:14:43 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 21 Sep 2017 01:14:43 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id DC5061A233A for ; Thu, 21 Sep 2017 01:14:42 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.929 X-Spam-Level: * X-Spam-Status: No, score=1.929 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id GhkEntPf9meB for ; Thu, 21 Sep 2017 01:14:40 +0000 (UTC) Received: from mail-qt0-f178.google.com (mail-qt0-f178.google.com [209.85.216.178]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id E11D4610F0 for ; Thu, 21 Sep 2017 01:14:39 +0000 (UTC) Received: by mail-qt0-f178.google.com with SMTP id f15so4573198qtf.7 for ; Wed, 20 Sep 2017 18:14:39 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=date:from:to:cc:message-id:in-reply-to:references:subject :mime-version; bh=rKEwXD/XsyZU2mraV8c7pKEnwYhF3nHuB1Dl58uGhy8=; b=PDXomta8CkGsvfZZzm5HeGk3T+dhloAGPZGPDsrt6V3bxBzriFcAzamCb2qMUi5XT6 3Bs8yT5qQj/Y030k3OCMM4Tp+9Sk5kG/LABRxv4Omg3e34YRQSVI0jbCM9vgAE6woZ9O X7LYl39Es1+cAKk+IekCB/axMTHw2tX9Xtkum9UyzGbX0BdNYRdxg9NXA5pt4S6Szllh hLoGn5fxe+3C5M2119mPNXUiaI58j1q18iLbm5EzX+XgMH1oCZhFwlwp40jV9JZTBYw3 6TAgSdWO5BIwCPgCjwpXsMqg0FnZ3YHmHbX71bfx3zRnbv3uXDdiZXD0ROP016Bz9En5 L4Ug== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:message-id:in-reply-to :references:subject:mime-version; bh=rKEwXD/XsyZU2mraV8c7pKEnwYhF3nHuB1Dl58uGhy8=; b=eU8g72Rvcc6z4eFoqfcq47CBuJiDe77upq6BGymTqNE5wbMqi4g3Z4LGPlmHK9E9i6 +xEXBKaJxcvXONOnnRzTdjOrFOdW5VknTHx5IMslG7H7ha7KjwjT1sQzlpOD70IVYh3m yiTjqaH8u4TWpVuKqa98fqdcHJIjz7kwOiiu4Jm1QXfkiycBX6cpnoChpz9mc8aJYEf2 GSZNG47e+HQ1t5k7UIGblYWQ7jTWv7qyJKHUVVN2bAALI/RntE376aH8n2rjK3x5HQ5q npLK39N4RxlKiEr/h5Tak6kIblOSe+Letcgx53JtrvKkVTL5PTh5E70BCObtEH9L8/sb MqJw== X-Gm-Message-State: AHPjjUg9WWMIR/KvHUR0/e8wiPK8vb5mQeTmXIHa1CK2mkKNpycWPq+3 tklhUzsbmJv4G84ufbZaxcA= X-Google-Smtp-Source: AOwi7QD5adYnpTCtk7vlZ6L+IQTAsUzpcratC7eyCdVMk/vd7VYichAc2hiJBJM/AK20V3gWTV222w== X-Received: by 10.200.50.149 with SMTP id z21mr585400qta.37.1505956479554; Wed, 20 Sep 2017 18:14:39 -0700 (PDT) Received: from Tesla.local (c-73-230-57-100.hsd1.pa.comcast.net. [73.230.57.100]) by smtp.gmail.com with ESMTPSA id m20sm200619qtm.22.2017.09.20.18.14.36 (version=TLS1_2 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Wed, 20 Sep 2017 18:14:37 -0700 (PDT) Date: Wed, 20 Sep 2017 21:14:36 -0400 From: Jim Miller To: Donald Szeto , user@predictionio.incubator.apache.org Cc: Pat Ferrel Message-ID: In-Reply-To: References: Subject: Re: Unable to connect to all storage backends successfully X-Mailer: Airmail (351) MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="59c3127c_619f6e9d_1e2" archived-at: Thu, 21 Sep 2017 01:14:46 -0000 --59c3127c_619f6e9d_1e2 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline Hi Donald, I did not. =C2=A0I will read the release notes and update accordingly. Thanks=21 Jim --=C2=A0 Jim Miller On September 20, 2017 at 1:01:53 PM, Donald Szeto (donald=40apache.org) w= rote: Hey Jim, Did you build PIO 0.12 with ES 1.4 support=3F ES 1.x is being deprecated = in 0.12 so the default build will use ES 5.x support. See the upcoming release notes:=C2=A0https://github.com/apache/incubator-= predictionio/blob/release/0.12.0/RELEASE.md=23behavior-changes Regards, Donald On Wed, Sep 20, 2017 at 8:14 AM, Jim Miller wr= ote: Yes.=C2=A0 I=E2=80=99m following this tutorial but using 0.12.0 instead o= f 0.10.0: https://medium.freecodecamp.org/building-an-recommendation-engine-with-ap= ache-prediction-io-ml-server-aed0319e0d8 --=C2=A0 Jim Miller On September 20, 2017 at 10:51:39 AM, Pat =46errel (pat=40occamsmachete.c= om) wrote: meaning is =E2=80=9Cfirstcluster=E2=80=9D the cluster name in your Elasti= csearch configuration=3F On Sep 19, 2017, at 8:54 PM, Vaghawan Ojha wrot= e: I think the problem is with Elasticsearch, are you sure the cluster exist= s in elasticsearch=C2=A0configuration=3F=C2=A0 On Wed, Sep 20, 2017 at 8:17 AM, Jim Miller wr= ote: Hi, I=E2=80=99m using=C2=A0PredictionIO 0.12.0-incubating with ElasticSearch = and Hbase: PredictionIO-0.12.0-incubating/vendors/elasticsearch-1.4.4 PredictionIO-0.12.0-incubating/vendors/hbase-1.0.0 PredictionIO-0.12.0-incubating/vendors/spark-1.5.1-bin-hadoop2.6 All starts with no errors but with pio status I get: =5BIN=46O=5D =5BManagement=24=5D Inspecting PredictionIO... =5BIN=46O=5D =5BManagement=24=5D PredictionIO 0.12.0-incubating is instal= led at /home/vagrant/pio/PredictionIO-0.12.0-incubating =5BIN=46O=5D =5BManagement=24=5D Inspecting Apache Spark... =5BIN=46O=5D =5BManagement=24=5D Apache Spark is installed at /home/vagra= nt/pio/PredictionIO-0.12.0-incubating/vendors/spark-1.5.1-bin-hadoop2.6 =5BIN=46O=5D =5BManagement=24=5D Apache Spark 1.5.1 detected (meets minim= um requirement of 1.3.0) =5BIN=46O=5D =5BManagement=24=5D Inspecting storage backend connections..= . =5BIN=46O=5D =5BStorage=24=5D Verifying Meta Data Backend (Source: ELASTI= CSEARCH)... =5BERROR=5D =5BManagement=24=5D Unable to connect to all storage backends= successfully. The following shows the error message from the storage backend. Connection closed (org.apache.predictionio.shaded.org.apache.http.Connect= ionClosedException) Dumping configuration of initialized storage backend sources. Please make sure they are correct. Source Name: ELASTICSEARCH; Type: elasticsearch; Configuration: HOME -> /= home/vagrant/pio/PredictionIO-0.12.0-incubating/vendors/elasticsearch-1.4= .4, HOSTS -> localhost, PORTS -> 9300, CLUSTERNAME -> firstcluster, TYPE = -> elasticsearch Can anyone give me an idea of what I need to fix this issue=3F=C2=A0 Here= is=C2=A0 =23 PredictionIO Main Configuration =23 =23 This section controls core behavior of PredictionIO. It is very likel= y that =23 you need to change these to fit your site. =23 SPARK=5FHOME: Apache Spark is a hard dependency and must be configure= d. =23 SPARK=5FHOME=3D=24PIO=5FHOME/vendors/spark-2.0.2-bin-hadoop2.7 SPARK=5FHOME=3D=24PIO=5FHOME/vendors/spark-1.5.1-bin-hadoop2.6 POSTGRES=5FJDBC=5FDRIVER=3D=24PIO=5FHOME/lib/postgresql-42.0.0.jar MYSQL=5FJDBC=5FDRIVER=3D=24PIO=5FHOME/lib/mysql-connector-java-5.1.41.jar= =23 ES=5FCON=46=5FDIR: You must configure this if you have advanced confi= guration for =23 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0your Elasticsearch se= tup. ES=5FCON=46=5FDIR=3D=24PIO=5FHOME/vendors/elasticsearch-1.4.4/conf =23 HADOOP=5FCON=46=5FDIR: You must configure this if you intend to run P= redictionIO =23 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0with Ha= doop 2. HADOOP=5FCON=46=5FDIR=3D=24PIO=5FHOME/vendors/spark-1.5.1-bin-hadoop2.6/c= onf =23 HBASE=5FCON=46=5FDIR: You must configure this if you intend to run Pr= edictionIO =23 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 with HBase on= a remote cluster. HBASE=5FCON=46=5FDIR=3D=24PIO=5FHOME/vendors/hbase-1.0.0/conf =23 =46ilesystem paths where PredictionIO uses as block storage. PIO=5F=46S=5FBASEDIR=3D=24HOME/.pio=5Fstore PIO=5F=46S=5FENGINESDIR=3D=24PIO=5F=46S=5FBASEDIR/engines PIO=5F=46S=5FTMPDIR=3D=24PIO=5F=46S=5FBASEDIR/tmp =23 PredictionIO Storage Configuration =23 =23 This section controls programs that make use of PredictionIO's built-= in =23 storage facilities. Default values are shown below. =23 =23 =46or more information on storage configuration please refer to =23 http://predictionio.incubator.apache.org/system/anotherdatastore/ =23 Storage Repositories =23 Default is to use PostgreSQL PIO=5FSTORAGE=5FREPOSITORIES=5FMETADATA=5FNAME=3Dpio=5Fmeta PIO=5FSTORAGE=5FREPOSITORIES=5FMETADATA=5FSOURCE=3DELASTICSEARCH PIO=5FSTORAGE=5FREPOSITORIES=5FEVENTDATA=5FNAME=3Dpio=5Fevent PIO=5FSTORAGE=5FREPOSITORIES=5FEVENTDATA=5FSOURCE=3DHBASE PIO=5FSTORAGE=5FREPOSITORIES=5FMODELDATA=5FNAME=3Dpio=5Fmodel PIO=5FSTORAGE=5FREPOSITORIES=5FMODELDATA=5FSOURCE=3DLOCAL=46S =23 Storage Data Sources =23 PostgreSQL Default Settings =23 Please change =22pio=22 to your database name in PIO=5FSTORAGE=5FSOUR= CES=5FPGSQL=5FURL =23 Please change PIO=5FSTORAGE=5FSOURCES=5FPGSQL=5FUSERNAME and =23 PIO=5FSTORAGE=5FSOURCES=5FPGSQL=5FPASSWORD accordingly =23 PIO=5FSTORAGE=5FSOURCES=5FPGSQL=5FTYPE=3Djdbc =23 PIO=5FSTORAGE=5FSOURCES=5FPGSQL=5FURL=3Djdbc:postgresql://localhost/p= io =23 PIO=5FSTORAGE=5FSOURCES=5FPGSQL=5FUSERNAME=3Dpio =23 PIO=5FSTORAGE=5FSOURCES=5FPGSQL=5FPASSWORD=3Dpio =23 MySQL Example =23 PIO=5FSTORAGE=5FSOURCES=5FMYSQL=5FTYPE=3Djdbc =23 PIO=5FSTORAGE=5FSOURCES=5FMYSQL=5FURL=3Djdbc:mysql://localhost/pio =23 PIO=5FSTORAGE=5FSOURCES=5FMYSQL=5FUSERNAME=3Dpio =23 PIO=5FSTORAGE=5FSOURCES=5FMYSQL=5FPASSWORD=3Dpio =23 Elasticsearch Example =23 PIO=5FSTORAGE=5FSOURCES=5FELASTICSEARCH=5FTYPE=3Delasticsearch =23 PIO=5FSTORAGE=5FSOURCES=5FELASTICSEARCH=5FHOSTS=3Dlocalhost =23 PIO=5FSTORAGE=5FSOURCES=5FELASTICSEARCH=5FPORTS=3D9200 =23 PIO=5FSTORAGE=5FSOURCES=5FELASTICSEARCH=5FSCHEMES=3Dhttp =23 PIO=5FSTORAGE=5FSOURCES=5FELASTICSEARCH=5FHOME=3D=24PIO=5FHOME/vendor= s/elasticsearch-5.5.2 =23 Optional basic HTTP auth =23 PIO=5FSTORAGE=5FSOURCES=5FELASTICSEARCH=5FUSERNAME=3Dmy-name =23 PIO=5FSTORAGE=5FSOURCES=5FELASTICSEARCH=5FPASSWORD=3Dmy-secret =23 Elasticsearch 1.x Example PIO=5FSTORAGE=5FSOURCES=5FELASTICSEARCH=5FTYPE=3Delasticsearch PIO=5FSTORAGE=5FSOURCES=5FELASTICSEARCH=5FCLUSTERNAME=3Dfirstcluster PIO=5FSTORAGE=5FSOURCES=5FELASTICSEARCH=5FHOSTS=3Dlocalhost PIO=5FSTORAGE=5FSOURCES=5FELASTICSEARCH=5FPORTS=3D9300 PIO=5FSTORAGE=5FSOURCES=5FELASTICSEARCH=5FHOME=3D=24PIO=5FHOME/vendors/el= asticsearch-1.4.4 =23 Local =46ile System Example PIO=5FSTORAGE=5FSOURCES=5FLOCAL=46S=5FTYPE=3Dlocalfs PIO=5FSTORAGE=5FSOURCES=5FLOCAL=46S=5FPATH=3D=24PIO=5F=46S=5FBASEDIR/mode= ls =23 HBase Example PIO=5FSTORAGE=5FSOURCES=5FHBASE=5FTYPE=3Dhbase PIO=5FSTORAGE=5FSOURCES=5FHBASE=5FHOME=3D=24PIO=5FHOME/vendors/hbase-1.0.= 0 =23 AWS S3 Example =23 PIO=5FSTORAGE=5FSOURCES=5FS3=5FTYPE=3Ds3 =23 PIO=5FSTORAGE=5FSOURCES=5FS3=5FBUCKET=5FNAME=3Dpio=5Fbucket =23 PIO=5FSTORAGE=5FSOURCES=5FS3=5FBASE=5FPATH=3Dpio=5Fmodel Thanks, Jim --=C2=A0 Jim Miller --59c3127c_619f6e9d_1e2 Content-Type: text/html; charset="utf-8" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline