Return-Path: X-Original-To: apmail-spark-user-archive@minotaur.apache.org Delivered-To: apmail-spark-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 48362178A7 for ; Wed, 21 Oct 2015 10:20:41 +0000 (UTC) Received: (qmail 80228 invoked by uid 500); 21 Oct 2015 10:20:38 -0000 Delivered-To: apmail-spark-user-archive@spark.apache.org Received: (qmail 80125 invoked by uid 500); 21 Oct 2015 10:20:38 -0000 Mailing-List: contact user-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@spark.apache.org Received: (qmail 80115 invoked by uid 99); 21 Oct 2015 10:20:38 -0000 Received: from Unknown (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 21 Oct 2015 10:20:38 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id AF9861A2A1A for ; Wed, 21 Oct 2015 10:20:37 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 4.998 X-Spam-Level: **** X-Spam-Status: No, score=4.998 tagged_above=-999 required=6.31 tests=[FSL_HELO_BARE_IP_2=1.999, HTML_MESSAGE=3, SPF_PASS=-0.001] autolearn=disabled Received: from mx1-eu-west.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id J7ybFeYpM_VN for ; Wed, 21 Oct 2015 10:20:35 +0000 (UTC) Received: from relayvx12c.securemail.intermedia.net (relayvx12c.securemail.intermedia.net [64.78.52.187]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with ESMTPS id 4289820927 for ; Wed, 21 Oct 2015 10:20:33 +0000 (UTC) Received: from securemail.intermedia.net (localhost [127.0.0.1]) (using TLSv1 with cipher AES256-SHA (256/256 bits)) (No client certificate requested) by emg-ca-1-2.localdomain (Postfix) with ESMTPS id 59D5F53E7C; Wed, 21 Oct 2015 03:20:32 -0700 (PDT) Subject: Re: spark-shell (1.5.1) not starting cleanly on Windows. MIME-Version: 1.0 x-echoworx-msg-id: 103ef7f4-6183-4f13-97f7-eb091c92d744 x-echoworx-emg-received: Wed, 21 Oct 2015 03:20:32.290 -0700 x-echoworx-action: delivered Received: from 10.254.155.17 ([10.254.155.17]) by emg-ca-1-2 (JAMES SMTP Server 2.3.2) with SMTP ID 137; Wed, 21 Oct 2015 03:20:32 -0700 (PDT) Received: from MBX080-W4-CO-1.exch080.serverpod.net (unknown [10.224.117.101]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by emg-ca-1-2.localdomain (Postfix) with ESMTPS id 08E6453E7C; Wed, 21 Oct 2015 03:20:32 -0700 (PDT) Received: from MBX080-W4-CO-2.exch080.serverpod.net (10.224.117.102) by MBX080-W4-CO-1.exch080.serverpod.net (10.224.117.101) with Microsoft SMTP Server (TLS) id 15.0.1044.25; Wed, 21 Oct 2015 03:20:30 -0700 Received: from MBX080-W4-CO-2.exch080.serverpod.net ([10.224.117.102]) by mbx080-w4-co-2.exch080.serverpod.net ([10.224.117.102]) with mapi id 15.00.1044.021; Wed, 21 Oct 2015 03:20:30 -0700 From: Steve Loughran To: Renato Perini CC: user Thread-Topic: spark-shell (1.5.1) not starting cleanly on Windows. Thread-Index: AQHRC5AvsPGQofXHs0u2CQ0P+SdbgJ52MnCA Date: Wed, 21 Oct 2015 10:20:30 +0000 Message-ID: <040A7D62-71F4-48A8-805F-1A828E1CD43D@hortonworks.com> References: <5626CFF5.30306@gmail.com> In-Reply-To: <5626CFF5.30306@gmail.com> Accept-Language: en-GB, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [86.178.206.108] x-source-routing-agent: Processed Content-Type: multipart/alternative; boundary="_000_040A7D6271F448A8805F1A828E1CD43Dhortonworkscom_" --_000_040A7D6271F448A8805F1A828E1CD43Dhortonworkscom_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable you've hit this https://wiki.apache.org/hadoop/WindowsProblems the next version of hadoop will fail with a more useful message, including = that wiki link On 21 Oct 2015, at 00:36, Renato Perini > wrote: java.lang.RuntimeException: java.lang.NullPointerException at org.apache.hadoop.hive.ql.session.SessionState.start(SessionStat= e.java:522) at org.apache.spark.sql.hive.client.ClientWrapper.(ClientWrap= per.scala:171) at org.apache.spark.sql.hive.HiveContext.executionHive$lzycompute(H= iveContext.scala:162) at org.apache.spark.sql.hive.HiveContext.executionHive(HiveContext.= scala:160) at org.apache.spark.sql.hive.HiveContext.(HiveContext.scala:1= 67) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Me= thod) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeCons= tructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Delega= tingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:422) at org.apache.spark.repl.SparkILoop.createSQLContext(SparkILoop.sca= la:1028) at $iwC$$iwC.(:9) at $iwC.(:18) at (:20) at .(:24) at .() at .(:7) at .() at $print() at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessor= Impl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethod= AccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.apache.spark.repl.SparkIMain$ReadEvalPrint.call(SparkIMain.s= cala:1065) at org.apache.spark.repl.SparkIMain$Request.loadAndRun(SparkIMain.s= cala:1340) at org.apache.spark.repl.SparkIMain.loadAndRunReq$1(SparkIMain.scal= a:840) at org.apache.spark.repl.SparkIMain.interpret(SparkIMain.scala:871) at org.apache.spark.repl.SparkIMain.interpret(SparkIMain.scala:819) at org.apache.spark.repl.SparkILoop.reallyInterpret$1(SparkILoop.sc= ala:857) --_000_040A7D6271F448A8805F1A828E1CD43Dhortonworkscom_ Content-Type: text/html; charset="us-ascii" Content-ID: <0D3DE39F85CED348A012BAB26F9E545E@exch080.serverpod.net> Content-Transfer-Encoding: quoted-printable you've hit this

https://wiki.apache.org/hadoop/WindowsProblems

the next version of hadoop will fail with a more useful mes= sage, including that wiki link


On 21 Oct 2015, at 00:36, Renato Perini <renato.perini@gmail.com> wrot= e:

java.lang.RuntimeException: java.lang.NullPointerException
        at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:= 522)
        at org.apache.spark.sql.hive.client.ClientWrapper.<init>(ClientWrapp= er.scala:171)
        at org.apache.spark.sql.hive.HiveContext.executionHive$lzycompute(HiveCont= ext.scala:162)
        at org.apache.spark.sql.hive.HiveContext.executionHive(HiveContext.scala:1= 60)
        at org.apache.spark.sql.hive.HiveContext.<init>(HiveContext.scala:16= 7)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructor= AccessorImpl.java:62)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingCon= structorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:422)<= br style=3D"font-family: Helvetica; font-size: 10px; font-style: normal; fo= nt-variant: normal; font-weight: normal; letter-spacing: normal; orphans: a= uto; text-align: start; text-indent: 0px; text-transform: none; white-space= : normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;"= class=3D"">         at org.apache.spark.repl.SparkILoop.createSQLContext(SparkILoop.scala:1028= )
        at $iwC$$iwC.<init>(<console>:9)
        at $iwC.<init>(<console>:18)
        at <init>(<console>:20)
        at .<init>(<console>:24)
        at .<clinit>(<console>)
        at .<init>(<console>:7)
        at .<clinit>(<console>)
        at $print(<console>)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.ja= va:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccesso= rImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:497)
        at org.apache.spark.repl.SparkIMain$ReadEvalPrint.call(SparkIMain.scala:10= 65)
        at org.apache.spark.repl.SparkIMain$Request.loadAndRun(SparkIMain.scala:13= 40)
        at org.apache.spark.repl.SparkIMain.loadAndRunReq$1(SparkIMain.scala:840)<= /span>
        at org.apache.spark.repl.SparkIMain.interpret(SparkIMain.scala:871)=
        at org.apache.spark.repl.SparkIMain.interpret(SparkIMain.scala:819)=
        at org.apache.spark.repl.SparkILoop.reallyInterpret$1(SparkILoop.scala:857= )

--_000_040A7D6271F448A8805F1A828E1CD43Dhortonworkscom_--