hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HADOOP-15113) NPE in S3A getFileStatus
Date Tue, 12 Dec 2017 18:38:00 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Steve Loughran updated HADOOP-15113:
------------------------------------
    Summary: NPE in S3A getFileStatus  (was: NPE in S3A getFileStatus: null metastore)

Not the metastore, mix of lines across versions

{code}
2017-12-12 18:36:20,511 [main] INFO  diag.S3ADiag (DurationInfo.java:<init>(46)) - Starting:
Deleting directory s3a://hwdev-steve-ireland-new/dir-fb664c3a-154b-40d6-9279-0fb8ac646c8c
2017-12-12 18:36:20,512 [main] WARN  diag.S3ADiag (S3ADiag.java:run(215)) - When deleting
s3a://hwdev-steve-ireland-new/dir-fb664c3a-154b-40d6-9279-0fb8ac646c8c: 
java.lang.NullPointerException
	at org.apache.hadoop.fs.s3a.S3AFileSystem.incrementStatistic(S3AFileSystem.java:1111)
	at org.apache.hadoop.fs.s3a.S3AFileSystem.incrementStatistic(S3AFileSystem.java:1102)
	at org.apache.hadoop.fs.s3a.S3AFileSystem.innerGetFileStatus(S3AFileSystem.java:2058)
	at org.apache.hadoop.fs.s3a.S3AFileSystem.delete(S3AFileSystem.java:1660)
	at org.apache.hadoop.fs.s3a.diag.S3ADiag.run(S3ADiag.java:213)
	at org.apache.hadoop.fs.s3a.diag.S3ADiag.run(S3ADiag.java:141)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:90)
	at org.apache.hadoop.fs.s3a.diag.S3ADiag.exec(S3ADiag.java:249)
	at org.apache.hadoop.fs.s3a.diag.S3ADiag.main(S3ADiag.java:260)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.hadoop.util.RunJar.run(RunJar.java:239)
	at org.apache.hadoop.util.RunJar.main(RunJar.java:153)
2017-12-12 18:36:20,513 [main] INFO  diag.S3ADiag (DurationInfo.java:close(57)) - Deleting
directory s3a://hwdev-steve-ireland-new/dir-fb664c3a-154b-40d6-9279-0fb8ac646c8c: duration
0:00:002
java.lang.NullPointerException
	at org.apache.hadoop.fs.s3a.S3AFileSystem.incrementStatistic(S3AFileSystem.java:1111)
	at org.apache.hadoop.fs.s3a.S3AFileSystem.incrementStatistic(S3AFileSystem.java:1102)
	at org.apache.hadoop.fs.s3a.S3AFileSystem.innerListFiles(S3AFileSystem.java:2948)
	at org.apache.hadoop.fs.s3a.S3AFileSystem.listFiles(S3AFileSystem.java:2936)
	at org.apache.hadoop.fs.s3a.diag.S3ADiag.run(S3ADiag.java:192)
	at org.apache.hadoop.fs.s3a.diag.S3ADiag.run(S3ADiag.java:141)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:90)
	at org.apache.hadoop.fs.s3a.diag.S3ADiag.exec(S3ADiag.java:249)
	at org.apache.hadoop.fs.s3a.diag.S3ADiag.main(S3ADiag.java:260)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.hadoop.util.RunJar.run(RunJar.java:239)
	at org.apache.hadoop.util.RunJar.main(RunJar.java:153)
2017-12-12 18:36:20,515 [main] INFO  util.ExitUtil (ExitUtil.java:terminate(210)) - Exiting
with status -1: java.lang.NullPointerException
~/P/h/h/t/hadoop-3.1.0-SNAPSHOT (s3guard/HADOOP-15107-correctness ⚡↩) 
{code}

> NPE in S3A getFileStatus
> ------------------------
>
>                 Key: HADOOP-15113
>                 URL: https://issues.apache.org/jira/browse/HADOOP-15113
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>    Affects Versions: 3.1.0
>            Reporter: Steve Loughran
>
> NPE in getFileStatus in a downstream test of mine; s3a ireland
> {{PathMetadata pm = metadataStore.get(path, needEmptyDirectoryFlag);. }}
> Something up with the bucket config?



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message