hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aaron Fabbri (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-14475) Metrics of S3A don't print out when enable it in Hadoop metrics property file
Date Wed, 29 Nov 2017 03:02:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-14475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16270034#comment-16270034
] 

Aaron Fabbri commented on HADOOP-14475:
---------------------------------------

Testing v15 patch I'm seeing occasional NPEs in test shutdown hooks where stats are incremented:

{noformat}
2017-11-28 18:35:32,936 [JUnit] INFO  v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(222))
- MiniMRYARN HistoryServer address: fabbri-mbp.lan:57551
2017-11-28 18:35:32,936 [JUnit] INFO  v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(224))
- MiniMRYARN HistoryServer web address: fabbri-MBP.lan:57550
2017-11-28 18:35:32,945 [Thread-1372] DEBUG s3a.S3ATestUtils (S3ATestUtils.java:maybeEnableS3Guard(402))
- Enabling S3Guard, authoritative=false, implementation=org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore
2017-11-28 18:35:32,945 [Thread-1372] INFO  s3a.S3ATestUtils (S3ATestUtils.java:enableInconsistentS3Client(793))
- Enabling inconsistent S3 client
2017-11-28 18:35:32,952 [Thread-1372] INFO  contract.AbstractFSContractTestBase (AbstractFSContractTestBase.java:setup(184))
- Test filesystem = s3a://fabbri-new implemented by S3AFileSystem{uri=s3a://fabbri-new, workingDir=s3a://fabbri-new/user/fabbri,
inputPolicy=normal, partSize=5242880, enableMultiObjectsDelete=true, maxKeys=5000, readAhead=65536,
blockSize=33554432, multiPartThreshold=5242880, serverSideEncryptionAlgorithm='NONE', blockFactory=org.apache.hadoop.fs.s3a.S3ADataBlocks$ArrayBlockFactory@11923456,
metastore=null, authoritative=false, useListV1=false, magicCommitter=true, boundedExecutor=BlockingThreadPoolExecutorService{SemaphoredDelegatingExecutor{permitCount=25,
available=25, waiting=0}, activeCount=0}, unboundedExecutor=java.util.concurrent.ThreadPoolExecutor@771d93da[Terminated,
pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 0], statistics {75761784
bytes read, 75796134 bytes written, 1197 read ops, 0 large read ops, 2330 write ops}}
2017-11-28 18:35:32,953 [Thread-1372] DEBUG s3a.S3AFileSystem (S3AFileSystem.java:innerMkdirs(1978))
- Making directory: s3a://fabbri-new/test
2017-11-28 18:35:32,953 [Thread-1372] ERROR contract.ContractTestUtils (ContractTestUtils.java:cleanup(376))
- Error deleting in TEARDOWN - /test: java.lang.NullPointerException
java.lang.NullPointerException
        at org.apache.hadoop.fs.s3a.S3AFileSystem.incrementStatistic(S3AFileSystem.java:1109)
        at org.apache.hadoop.fs.s3a.S3AFileSystem.incrementStatistic(S3AFileSystem.java:1100)
        at org.apache.hadoop.fs.s3a.S3AFileSystem.exists(S3AFileSystem.java:2879)
        at org.apache.hadoop.fs.contract.ContractTestUtils.rm(ContractTestUtils.java:397)
        at org.apache.hadoop.fs.contract.ContractTestUtils.cleanup(ContractTestUtils.java:374)
        at org.apache.hadoop.fs.contract.AbstractFSContractTestBase.deleteTestDirInTeardown(AbstractFSContractTestBase.java:213)
        at org.apache.hadoop.fs.contract.AbstractFSContractTestBase.teardown(AbstractFSContractTestBase.java:204)
        at org.apache.hadoop.fs.s3a.AbstractS3ATestBase.teardown(AbstractS3ATestBase.java:56)
        at org.apache.hadoop.fs.s3a.commit.AbstractCommitITest.teardown(AbstractCommitITest.java:185)
        at sun.reflect.GeneratedMethodAccessor16.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
{noformat}

Quick glance at code, looks like {{instrumentation}} is null.  It gets set in {{initialize()}}
and closed / set to null in {{close()}}, so I wonder if this is test code using the FS after
close()?  Would be easy enough to test.

> Metrics of S3A don't print out  when enable it in Hadoop metrics property file
> ------------------------------------------------------------------------------
>
>                 Key: HADOOP-14475
>                 URL: https://issues.apache.org/jira/browse/HADOOP-14475
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>    Affects Versions: 2.8.0
>         Environment: uname -a
> Linux client01 4.4.0-74-generic #95-Ubuntu SMP Wed Apr 12 09:50:34 UTC 2017 x86_64 x86_64
x86_64 GNU/Linux
>  cat /etc/issue
> Ubuntu 16.04.2 LTS \n \l
>            Reporter: Yonger
>            Assignee: Yonger
>         Attachments: HADOOP-14475-003.patch, HADOOP-14475.002.patch, HADOOP-14475.005.patch,
HADOOP-14475.006.patch, HADOOP-14475.008.patch, HADOOP-14475.009.patch, HADOOP-14475.010.patch,
HADOOP-14475.011.patch, HADOOP-14475.012.patch, HADOOP-14475.013.patch, HADOOP-14475.014.patch,
HADOOP-14475.015.patch, HADOOP-14775.007.patch, failsafe-report-s3a-it.html, failsafe-report-s3a-scale.html,
failsafe-report-scale.html, failsafe-report-scale.zip, s3a-metrics.patch1, stdout.zip
>
>
> *.sink.file.class=org.apache.hadoop.metrics2.sink.FileSink
> #*.sink.file.class=org.apache.hadoop.metrics2.sink.influxdb.InfluxdbSink
> #*.sink.influxdb.url=http:/xxxxxxxxxx
> #*.sink.influxdb.influxdb_port=8086
> #*.sink.influxdb.database=hadoop
> #*.sink.influxdb.influxdb_username=hadoop
> #*.sink.influxdb.influxdb_password=hadoop
> #*.sink.ingluxdb.cluster=c1
> *.period=10
> #namenode.sink.influxdb.class=org.apache.hadoop.metrics2.sink.influxdb.InfluxdbSink
> #S3AFileSystem.sink.influxdb.class=org.apache.hadoop.metrics2.sink.influxdb.InfluxdbSink
> S3AFileSystem.sink.file.filename=s3afilesystem-metrics.out
> I can't find the out put file even i run a MR job which should be used s3.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message