Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id D1879200CC1 for ; Mon, 10 Jul 2017 18:27:43 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id CFE06163E35; Mon, 10 Jul 2017 16:27:43 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id A07AC163E2F for ; Mon, 10 Jul 2017 18:27:42 +0200 (CEST) Received: (qmail 89589 invoked by uid 500); 10 Jul 2017 16:27:36 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Delivered-To: moderator for dev@hive.apache.org Received: (qmail 6650 invoked by uid 99); 10 Jul 2017 14:39:01 -0000 X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.379 X-Spam-Level: ** X-Spam-Status: No, score=2.379 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=OLTgnt86FbTww9o8AysrinrcjvqyOVg00CEultH2+00=; b=pSBLYeOnZNVu5WrEHDyLNvXX070Px98SMCafy30eM7DP8FCC0zibbv0qSZevR6zsMn UIR5EMOADKIq7MSF60JrwMwwn9DoUeklGx6bWLPN3f1s7GmtlgWR/Z8bszxvoo7Nk0NI 3/YLp3bz7k9BsMUiTO53ff0sCMpAtndmmAkUmkGbr8zdFcPmV5PGgFRKMdx+S317QoKL 2X9KWKrpLW1PW51cGbdVgU19+BTSwVnbqN1hUKB5I70EDCOH+G0Eg4540nBb8hYu7Drc 2bWgl5DQaDmRwXCm9DeqMPte1xa2XFhEUjjXNyicu/5rDGFvYqGtBAXS+HQWMm8hWcMx stVA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=OLTgnt86FbTww9o8AysrinrcjvqyOVg00CEultH2+00=; b=NwlM0CjlMZSqIqxpKPkO6+hD4/A4vfmYuesB2XogNPCuI3zIMOWxqGpcbxP1I0z9Dd 4QXcpv1U9X8XpnjG6nxcKRuI3SdTXcQp8L5jSr5yLsO5w6Mo7gFZjduyI7B/w21tsj8F u1YnOYnXLBwHMfbnlrtRUPxO1GiGd4yzm88w4bsK6Q9/f/HEBPiO03z5TD9xzSzDYlNV ezegg409kumDX/8yBo1kTortQJ9pBqtYI/vnNY7APsRuo6wHGzGqOF4u5wxp6JP1xxTx uXYf0oZceHXn/21sN5XbfwsILuHMZva5W6ZJga/xMErYGNTW/OXRf5CY8zfZ27V4hfUk oLuw== X-Gm-Message-State: AIVw113Gla7rvaIL5X17gFJHROgNOetbVNDW5zk4JyL0SZvJhq73yeiD tkePpXX8WSgyYGD/UldfqiZ2DHDzIW5oP9s= X-Received: by 10.237.63.141 with SMTP id s13mr4902138qth.61.1499697533979; Mon, 10 Jul 2017 07:38:53 -0700 (PDT) MIME-Version: 1.0 From: "Federico D'Ambrosio" Date: Mon, 10 Jul 2017 16:38:53 +0200 Message-ID: Subject: Non-local session path expected to be non-null trying to write on Hive using storm-hive To: user@hive.apache.org, dev@hive.apache.org Content-Type: multipart/mixed; boundary="001a11456c04c8ce680553f78a79" archived-at: Mon, 10 Jul 2017 16:27:44 -0000 --001a11456c04c8ce680553f78a79 Content-Type: multipart/alternative; boundary="001a11456c04c8ce640553f78a77" --001a11456c04c8ce640553f78a77 Content-Type: text/plain; charset="UTF-8" Greetings, I'mtrying to get a working dataflow stack on a 6 node cluster (2 masters + 4 slaves, no Kerberos) using Kafka (2.10_0.10), Storm (1.0.1) and Hive2 (1.2.1). Storm is able to communicate with Kafka, but can't seemingly operate on Hive (on master-1), even though it manages to connect to its metastore. I thought originally it was a problem of permissions on either HDFS or the local filesystem, but even though I set 777 permissions on /tmp/hive, there's still this issue. In core-site.xml: - hadoop.proxyuser.hcat.group - hadoop.proxyuser.hcat.hosts - hadoop.proxyuser.hdfs.groups - hadoop.proxyuser.hdfs.hosts - hadoop.proxyuser.hive.groups - hadoop.proxyuser.hive.hosts - hadoop.proxyuser.root.groups - hadoop.proxyuser.root.hosts are all set to '*'. Hive2, as far as I see is correctly set to work with transactions, being the target table with transactional=true, stored as orc and bucketed. In the hive-site.xml: - hive.compactor.worker.threads = 1 - hive.compactor.initiator.on = true - hive.txn.manager = org.apache.hadoop.hive.ql.lockmgr.DbTxnManager I get a Nullpointer Exception, you may find the stack trace among the attached files. From what I can gather, the NullpointerException is thrown in the following method inside SessionState: 1. public static Path getHDFSSessionPath(Configuration conf) { 2. SessionState ss = SessionState.get(); 3. if (ss == null) { 4. String sessionPathString = conf.get(HDFS_SESSION_PATH_KEY); 5. Preconditions.checkNotNull(sessionPathString, "Conf non-local session path expected to be non-null"); 6. return new Path(sessionPathString); 7. } 8. Preconditions.checkNotNull(ss.hdfsSessionPath, "Non-local session path expected to be non-null"); 9. return ss.hdfsSessionPath; 10. } Specifically, by: 1. Preconditions.checkNotNull(ss.hdfsSessionPath, "Non-local session path expected to be non-null"); So, it seems to be an hdfs related issue, but I can't understand why it's happening. From what I gather, this occurs when Hive tries to retrieve the local path of the session, which is stored in the _hive.local.session.path configuration variable. The value of this variable is assigned each time a new Hive session is created, and it is formed by merging the path for user temporary files (hive.exec.local.scratchdir) to the session ID ( hive.session.id). If indeed is a permissions issue, what should I look into to find the origin of the issue? Thanks for your help, Federico --001a11456c04c8ce640553f78a77 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable

Greetings,

I'mtrying to get a working dataflow stack on a 6 node=20 cluster (2 masters + 4 slaves, no Kerberos) using Kafka (2.10_0.10),=20 Storm (1.0.1) and Hive2 (1.2.1). Storm is able=20 to communicate with Kafka, but can't seemingly operate on Hive (on master-1), even though it=20 manages to connect to its metastore.

I thought originally it was a problem of permissions on either HDFS=20 or the local filesystem, but even though I set 777 permissions on=20 /tmp/hive, there's still this issue.

In core-site.xml:

  • hadoop.proxyuser.hcat.group

  • hadoop.proxyuser.hcat.hosts

  • hadoop.proxyuser.hdfs.groups
  • hadoop.proxyuser.hdfs.hosts =
  • hadoop.proxyuser.hive.groups
  • hadoop.proxyuser.hive.hosts =
  • hadoop.proxyuser.root.groups
  • hadoop.proxyuser.root.hosts =

are all set to '*'.

Hive2, as far as I see is correctly set to work with transactions,=20 being the target table with transactional=3Dtrue, stored as orc and=20 bucketed. In the hive-site.xml:

  • hive.compactor.worker.threads =3D 1
  • hive.compactor.initiato= r.on =3D true
  • hive.txn.manager =3D org.apache.hadoop.hive.ql.l= ockmgr.DbTxnManager
I get a Nullpointer Exception, you may find the stack trace among the attac= hed files.

From what I can gather, the NullpointerException is thrown in the fol= lowing method inside SessionState:

  1. public static =
Path getHDFSSessionPath(Configuration conf) {  
  2. 	SessionState ss =3D SessionState.get();=
  
  3. 	if (ss =3D=
=3D null) {  
  4. 		=
String sessionPathString =3D conf.get<=
span class=3D"gmail-m_-7101986386706486980pun">(HDFS_SESSION_PATH_KEY);  
  5. =
		Preconditions.checkNotNull(sessionPathString<=
/span>,  "Conf non-local session path expected to be non-nul=
l");  
  6. 		return new Path=
(sessionPathString);  
  7. 	}  
  8. 	Preconditions.checkNotNul=
l(ss.=
hdfsSessionPath=
,  "Non-local session path expected=
 to be non-null");  
    9. 	retu=
rn ss.hdfsSessionPath;
  9. <=
span class=3D"gmail-m_-7101986386706486980pun">}

Specifically, by: 

  1. Preconditions.checkNotNull(ss.hdfsSessionPath, "Non-loca=
l session path expected to be non-null");

So, it seems to be an hdfs related issue, but I can't understand why= it's happening.

From what I gather, this occurs when Hive tries = to retrieve the local path of the session, which is stored in the _hi= ve.local.session.path configuration variable. The value of this variable is assigned each=20 time a new Hive session is created, and it is formed by merging the path for user temporary files (hive.exec.local.scratchdir) to the = session ID (hive.session.id).

If indeed is a permissions issue, what should I look into to f= ind the origin of the issue?

Thanks for your help,

Federico
=

--001a11456c04c8ce640553f78a77-- --001a11456c04c8ce680553f78a79 Content-Type: text/plain; charset="US-ASCII"; name="stacktrace.txt" Content-Disposition: attachment; filename="stacktrace.txt" Content-Transfer-Encoding: base64 X-Attachment-Id: f_j4y8x8m20 ICAgIDIwMTctMDctMDggMTA6MDI6MzYuODk2IG8uYS5zLmgudC5IaXZlU3RhdGUgW0lORk9dIENy ZWF0aW5nIFdyaXRlciB0byBIaXZlIGVuZCBwb2ludCA6IHttZXRhU3RvcmVVcmk9J3RocmlmdDov L21hc3Rlci0xLmxvY2FsZG9tYWluOjkwODMsdGhyaWZ0Oi8vbWFzdGVyLTIubG9jYWxkb21haW46 OTA4MycsIGRhdGFiYXNlPSdkYXRhX3N0cmVhbScsIHRhYmxlPSdhaXJfdHJhZmZpY190ZXN0Jywg cGFydGl0aW9uVmFscz1bMjAxNy8wNy8xODldIH0NCiAgICAyMDE3LTA3LTA4IDEwOjAyOjM2Ljkx MSBoLm1ldGFzdG9yZSBbSU5GT10gVHJ5aW5nIHRvIGNvbm5lY3QgdG8gbWV0YXN0b3JlIHdpdGgg VVJJIHRocmlmdDovL21hc3Rlci0xLmxvY2FsZG9tYWluOjkwODMNCiAgICAyMDE3LTA3LTA4IDEw OjAyOjM2LjkxMiBoLm1ldGFzdG9yZSBbSU5GT10gQ29ubmVjdGVkIHRvIG1ldGFzdG9yZS4NCiAg ICAyMDE3LTA3LTA4IDEwOjAyOjM2LjkyMyBvLmEuaC5oLnEubC5QZXJmTG9nZ2VyIFtJTkZPXSA8 UEVSRkxPRyBtZXRob2Q9RHJpdmVyLnJ1biBmcm9tPW9yZy5hcGFjaGUuaGFkb29wLmhpdmUucWwu RHJpdmVyPg0KICAgIDIwMTctMDctMDggMTA6MDI6MzYuOTIzIG8uYS5oLmgucS5sLlBlcmZMb2dn ZXIgW0lORk9dIDxQRVJGTE9HIG1ldGhvZD1UaW1lVG9TdWJtaXQgZnJvbT1vcmcuYXBhY2hlLmhh ZG9vcC5oaXZlLnFsLkRyaXZlcj4NCiAgICAyMDE3LTA3LTA4IDEwOjAyOjM2LjkyMyBvLmEuaC5o LnEubC5QZXJmTG9nZ2VyIFtJTkZPXSA8UEVSRkxPRyBtZXRob2Q9Y29tcGlsZSBmcm9tPW9yZy5h cGFjaGUuaGFkb29wLmhpdmUucWwuRHJpdmVyPg0KICAgIDIwMTctMDctMDggMTA6MDI6MzYuOTIz IFNURElPIFtFUlJPUl0gRkFJTEVEOiBOdWxsUG9pbnRlckV4Y2VwdGlvbiBOb24tbG9jYWwgc2Vz c2lvbiBwYXRoIGV4cGVjdGVkIHRvIGJlIG5vbi1udWxsDQogICAgMjAxNy0wNy0wOCAxMDowMjoz Ni45MjMgby5hLmguaC5xLkRyaXZlciBbRVJST1JdIEZBSUxFRDogTnVsbFBvaW50ZXJFeGNlcHRp b24gTm9uLWxvY2FsIHNlc3Npb24gcGF0aCBleHBlY3RlZCB0byBiZSBub24tbnVsbA0KICAgIGph dmEubGFuZy5OdWxsUG9pbnRlckV4Y2VwdGlvbjogTm9uLWxvY2FsIHNlc3Npb24gcGF0aCBleHBl Y3RlZCB0byBiZSBub24tbnVsbA0KICAgIAlhdCBjb20uZ29vZ2xlLmNvbW1vbi5iYXNlLlByZWNv bmRpdGlvbnMuY2hlY2tOb3ROdWxsKFByZWNvbmRpdGlvbnMuamF2YToyMjkpDQogICAgCWF0IG9y Zy5hcGFjaGUuaGFkb29wLmhpdmUucWwuc2Vzc2lvbi5TZXNzaW9uU3RhdGUuZ2V0SERGU1Nlc3Np b25QYXRoKFNlc3Npb25TdGF0ZS5qYXZhOjU5MCkNCiAgICAJYXQgb3JnLmFwYWNoZS5oYWRvb3Au aGl2ZS5xbC5Db250ZXh0Ljxpbml0PihDb250ZXh0LmphdmE6MTI5KQ0KICAgIAlhdCBvcmcuYXBh Y2hlLmhhZG9vcC5oaXZlLnFsLkNvbnRleHQuPGluaXQ+KENvbnRleHQuamF2YToxMTYpDQogICAg CWF0IG9yZy5hcGFjaGUuaGFkb29wLmhpdmUucWwuRHJpdmVyLmNvbXBpbGUoRHJpdmVyLmphdmE6 MzgyKQ0KICAgIAlhdCBvcmcuYXBhY2hlLmhhZG9vcC5oaXZlLnFsLkRyaXZlci5jb21waWxlKERy aXZlci5qYXZhOjMwMykNCiAgICAJYXQgb3JnLmFwYWNoZS5oYWRvb3AuaGl2ZS5xbC5Ecml2ZXIu Y29tcGlsZUludGVybmFsKERyaXZlci5qYXZhOjEwNjcpDQogICAgCWF0IG9yZy5hcGFjaGUuaGFk b29wLmhpdmUucWwuRHJpdmVyLnJ1bkludGVybmFsKERyaXZlci5qYXZhOjExMjkpDQogICAgCWF0 IG9yZy5hcGFjaGUuaGFkb29wLmhpdmUucWwuRHJpdmVyLnJ1bihEcml2ZXIuamF2YToxMDA0KQ0K ICAgIAlhdCBvcmcuYXBhY2hlLmhhZG9vcC5oaXZlLnFsLkRyaXZlci5ydW4oRHJpdmVyLmphdmE6 OTk0KQ0KICAgIAlhdCBvcmcuYXBhY2hlLmhpdmUuaGNhdGFsb2cuc3RyZWFtaW5nLkhpdmVFbmRQ b2ludCRDb25uZWN0aW9uSW1wbC5ydW5EREwoSGl2ZUVuZFBvaW50LmphdmE6NDA0KQ0KICAgIAlh dCBvcmcuYXBhY2hlLmhpdmUuaGNhdGFsb2cuc3RyZWFtaW5nLkhpdmVFbmRQb2ludCRDb25uZWN0 aW9uSW1wbC5jcmVhdGVQYXJ0aXRpb25JZk5vdEV4aXN0cyhIaXZlRW5kUG9pbnQuamF2YTozNjkp DQogICAgCWF0IG9yZy5hcGFjaGUuaGl2ZS5oY2F0YWxvZy5zdHJlYW1pbmcuSGl2ZUVuZFBvaW50 JENvbm5lY3Rpb25JbXBsLjxpbml0PihIaXZlRW5kUG9pbnQuamF2YToyNzYpDQogICAgCWF0IG9y Zy5hcGFjaGUuaGl2ZS5oY2F0YWxvZy5zdHJlYW1pbmcuSGl2ZUVuZFBvaW50JENvbm5lY3Rpb25J bXBsLjxpbml0PihIaXZlRW5kUG9pbnQuamF2YToyNDMpDQogICAgCWF0IG9yZy5hcGFjaGUuaGl2 ZS5oY2F0YWxvZy5zdHJlYW1pbmcuSGl2ZUVuZFBvaW50Lm5ld0Nvbm5lY3Rpb25JbXBsKEhpdmVF bmRQb2ludC5qYXZhOjE4MCkNCiAgICAJYXQgb3JnLmFwYWNoZS5oaXZlLmhjYXRhbG9nLnN0cmVh bWluZy5IaXZlRW5kUG9pbnQubmV3Q29ubmVjdGlvbihIaXZlRW5kUG9pbnQuamF2YToxNTcpDQog ICAgCWF0IG9yZy5hcGFjaGUuc3Rvcm0uaGl2ZS5jb21tb24uSGl2ZVdyaXRlciQ1LmNhbGwoSGl2 ZVdyaXRlci5qYXZhOjIzOCkNCiAgICAJYXQgb3JnLmFwYWNoZS5zdG9ybS5oaXZlLmNvbW1vbi5I aXZlV3JpdGVyJDUuY2FsbChIaXZlV3JpdGVyLmphdmE6MjM1KQ0KICAgIAlhdCBvcmcuYXBhY2hl LnN0b3JtLmhpdmUuY29tbW9uLkhpdmVXcml0ZXIkOS5jYWxsKEhpdmVXcml0ZXIuamF2YTozNjYp DQogICAgCWF0IGphdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2sucnVuKEZ1dHVyZVRhc2su amF2YToyNjYpDQogICAgCWF0IGphdmEudXRpbC5jb25jdXJyZW50LlRocmVhZFBvb2xFeGVjdXRv ci5ydW5Xb3JrZXIoVGhyZWFkUG9vbEV4ZWN1dG9yLmphdmE6MTE0MikNCiAgICAJYXQgamF2YS51 dGlsLmNvbmN1cnJlbnQuVGhyZWFkUG9vbEV4ZWN1dG9yJFdvcmtlci5ydW4oVGhyZWFkUG9vbEV4 ZWN1dG9yLmphdmE6NjE3KQ0KICAgIAlhdCBqYXZhLmxhbmcuVGhyZWFkLnJ1bihUaHJlYWQuamF2 YTo3NDUpDQogICAgIA0KICAgIDIwMTctMDctMDggMTA6MDI6MzYuOTIzIG8uYS5oLmgucS5sLlBl cmZMb2dnZXIgW0lORk9dIDwvUEVSRkxPRyBtZXRob2Q9Y29tcGlsZSBzdGFydD0xNDk5NTA0NTU2 OTIzIGVuZD0xNDk5NTA0NTU2OTIzIGR1cmF0aW9uPTAgZnJvbT1vcmcuYXBhY2hlLmhhZG9vcC5o aXZlLnFsLkRyaXZlcj4NCiAgICAyMDE3LTA3LTA4IDEwOjAyOjM2LjkyNCBvLmEucy5oLnQuSGl2 ZVN0YXRlIFtXQVJOXSBoaXZlIHN0cmVhbWluZyBmYWlsZWQuDQogICAgamF2YS5sYW5nLk51bGxQ b2ludGVyRXhjZXB0aW9u --001a11456c04c8ce680553f78a79--