hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ai Deng (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-14425) Add more s3guard metrics
Date Mon, 15 May 2017 22:46:04 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-14425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16011454#comment-16011454
] 

Ai Deng commented on HADOOP-14425:
----------------------------------

Hi [~stevel@apache.org], i think the metrics about "mismatches between s3guard and the underlying
object store" you mentioned is a little difficult to add.
Below is my understanding, please correct me if I'm wrong:
in S3Guard design, the metadataStore is the source of truth, if the path is marked as "Authoritative"
and has the status in metadataStore, we return the status from metaDataStore directly, but
in S3mper, the source of the truth is S3, the list path action always check with S3, so the
S3mper could find the mismatches. 

We can discuss this and other metrics further before start to add them.

> Add more s3guard metrics
> ------------------------
>
>                 Key: HADOOP-14425
>                 URL: https://issues.apache.org/jira/browse/HADOOP-14425
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>            Reporter: Ai Deng
>
> The metrics suggested to add:
> Status:
> S3GUARD_METADATASTORE_ENABLED
> S3GUARD_METADATASTORE_IS_AUTHORITATIVE
> Operations:
> S3GUARD_METADATASTORE_INITIALIZATION
> S3GUARD_METADATASTORE_DELETE_PATH
> S3GUARD_METADATASTORE_DELETE_PATH_LATENCY
> S3GUARD_METADATASTORE_DELETE_SUBTREE_PATCH
> S3GUARD_METADATASTORE_GET_PATH
> S3GUARD_METADATASTORE_GET_PATH_LATENCY
> S3GUARD_METADATASTORE_GET_CHILDREN_PATH
> S3GUARD_METADATASTORE_GET_CHILDREN_PATH_LATENCY
> S3GUARD_METADATASTORE_MOVE_PATH
> S3GUARD_METADATASTORE_PUT_PATH
> S3GUARD_METADATASTORE_PUT_PATH_LATENCY
> S3GUARD_METADATASTORE_CLOSE
> S3GUARD_METADATASTORE_DESTORY
> From S3Guard:
> S3GUARD_METADATASTORE_MERGE_DIRECTORY
> For the failures:
> S3GUARD_METADATASTORE_DELETE_FAILURE
> S3GUARD_METADATASTORE_GET_FAILURE
> S3GUARD_METADATASTORE_PUT_FAILURE
> Etc:
> S3GUARD_METADATASTORE_PUT_RETRY_TIMES



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message