hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Templeton (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-9780) RollingFileSystemSink doesn't work on secure clusters
Date Sun, 14 Feb 2016 05:05:18 GMT

    [ https://issues.apache.org/jira/browse/HDFS-9780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15146382#comment-15146382
] 

Daniel Templeton commented on HDFS-9780:
----------------------------------------

The issue is not this patch.  You're seeing HADOOP-12090 rearing its head.  The message happened
to be split across two TCP packets, causing the KDC to reject it.  If you look at the stack
trace in the HDFS-9711 logs, it's identical to HADOOP-12090:

{code}
EXCEPTION
org.apache.mina.filter.codec.ProtocolDecoderException: java.lang.NullPointerException: message
(Hexdump: 00 00 02 43 6C 82 02 3F 30 82 02 3B A1 03 02 01 05 A2 03 02 01 0C A3 82 01 C2 30
82 01 BE 30 82 01 BA A1 03 02 01 01 A2 82 01 B1 04 82 01 AD 6E 82 01 A9 30 82 01 A5 A0 03
02 01 05 A1 03 02 01 0E A2 07 03 05 00 00 00 00 00 A3 81 F5 61 81 F2 30 81 EF A0 03 02 01
05 A1 0D 1B 0B 45 58 41 4D 50 4C 45 2E 43 4F 4D A2 20 30 1E A0 03 02 01 02 A1 17 30 15 1B
06 6B 72 62 74 67 74 1B 0B 45 58 41 4D 50 4C 45 2E 43 4F 4D A3 81 B6 30 81 B3 A0 03 02 01
11 A2 81 AB 04 81 A8 CD 9D D5 D9 84 E1 75 0B AE 35 44 84 E6 25 3D 07 9F 15 43 E8 31 D3 8D
2A 45 41 F2 2B B4 4D C4 0F 24 A2 70 F2 53 2A C7 A9 9C 93 54 43 6E C0 5F B4 47 49 7F 49 C1
96 18 4E F1 F6 07 55 A7 B2 2C 6C 6A D1 82 60 A1 04 29 D2 BB 38 6D D9 88 40 7B 85 24 CD B3
37 04 08 34 4D C4 24 EB 45 CE AD 70 6C 3A C2 8E 73 60 6F D4 36 44 D0 01 62 75 73 85 91 98
54 59 05 E8 B4 34 72 00 30 D5 4F 4C 39 4D D9 4C 5E 46 C6 63 DB 6D B0 15 D6 88 0A F0 C5 C8
43 A7 9D 71 69 AF 80 4A 52 DB 8D 0B E0 C0 80 24 28 EF DC F4 71 B5 2F 91 64 A4 81 97 30 81
94 A0 03 02 01 11 A2 81 8C 04 81 89 17 CE ED C3 54 CD A3 A0 81 CE 3C 31 B4 09 2C 29 A2 B4
30 5D 88 28 04 75 15 CA D7 3C 0C B2 DF 07 84 A4 0D AF 71 EB 55 39 D4 A1 C0 70 99 9A 11 9E
DA C3 96 ED C2 6F 3E 32 F8 55 83 0C F8 3E 8E 05 20 46 49 02 AF 0C 6A 53 58 80 93 F4 14 86
A9 60 2E 00 CD BD 6E 93 23 9D 8B 5C D9 D8 96 23 56 AB 61 7F 78 29 29 98 86 33 48 A2 11 F7
6F 11 39 CE D4 FB F4 DE 76 88 70 A7 09 8C CA A8 BC C6 89 A6 7D 7C FB 50 EA 47 7B 43 7F A4
69 30 67 A0 07 03 05 00 00 00 00 00 A2 0D 1B 0B 45 58 41 4D 50 4C 45 2E 43 4F 4D A3 1C 30
1A A0 03 02 01 00 A1 13 30 11 1B 04 68 64 66 73 1B 09 6C 6F 63 61 6C 68 6F 73 74 A5 11 18
0F 31 39 37 30 30 31 30 31 30 30 30 30 30 30 5A A7 06 02 04 4E 5A 84 B4 A8 14 30 12 02 01
12 02 01 11 02 01 10 02 01)
	at org.apache.mina.filter.codec.ProtocolCodecFilter.messageReceived(ProtocolCodecFilter.java:234)
	at org.apache.mina.core.filterchain.DefaultIoFilterChain.callNextMessageReceived(DefaultIoFilterChain.java:434)
	at org.apache.mina.core.filterchain.DefaultIoFilterChain.access$1200(DefaultIoFilterChain.java:48)
	at org.apache.mina.core.filterchain.DefaultIoFilterChain$EntryImpl$1.messageReceived(DefaultIoFilterChain.java:802)
	at org.apache.mina.core.filterchain.IoFilterAdapter.messageReceived(IoFilterAdapter.java:120)
	at org.apache.mina.core.filterchain.DefaultIoFilterChain.callNextMessageReceived(DefaultIoFilterChain.java:434)
	at org.apache.mina.core.filterchain.DefaultIoFilterChain.fireMessageReceived(DefaultIoFilterChain.java:426)
	at org.apache.mina.core.polling.AbstractPollingIoProcessor.read(AbstractPollingIoProcessor.java:604)
	at org.apache.mina.core.polling.AbstractPollingIoProcessor.process(AbstractPollingIoProcessor.java:564)
	at org.apache.mina.core.polling.AbstractPollingIoProcessor.process(AbstractPollingIoProcessor.java:553)
	at org.apache.mina.core.polling.AbstractPollingIoProcessor.access$400(AbstractPollingIoProcessor.java:57)
	at org.apache.mina.core.polling.AbstractPollingIoProcessor$Processor.run(AbstractPollingIoProcessor.java:892)
	at org.apache.mina.util.NamePreservingRunnable.run(NamePreservingRunnable.java:65)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NullPointerException: message
	at org.apache.mina.filter.codec.AbstractProtocolDecoderOutput.write(AbstractProtocolDecoderOutput.java:44)
	at org.apache.directory.server.kerberos.protocol.codec.MinaKerberosDecoder.decode(MinaKerberosDecoder.java:65)
	at org.apache.mina.filter.codec.ProtocolCodecFilter.messageReceived(ProtocolCodecFilter.java:224)
	... 15 more
{code}

> RollingFileSystemSink doesn't work on secure clusters
> -----------------------------------------------------
>
>                 Key: HDFS-9780
>                 URL: https://issues.apache.org/jira/browse/HDFS-9780
>             Project: Hadoop HDFS
>          Issue Type: Bug
>    Affects Versions: 2.9.0
>            Reporter: Daniel Templeton
>            Assignee: Daniel Templeton
>            Priority: Critical
>         Attachments: HADOOP-12775.001.patch, HADOOP-12775.002.patch, HADOOP-12775.003.patch,
HDFS-9780.004.patch, HDFS-9780.005.patch, HDFS-9780.006.patch, HDFS-9780.006.patch, HDFS-9780.007.patch,
HDFS-9780.008.patch
>
>
> If HDFS has kerberos enabled, the sink cannot write its logs.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message