hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anu Engineer (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-11698) Ozone: SCM: CLI: Add Debug command
Date Mon, 24 Apr 2017 20:07:04 GMT
Anu Engineer created HDFS-11698:

             Summary: Ozone: SCM: CLI:  Add Debug command
                 Key: HDFS-11698
                 URL: https://issues.apache.org/jira/browse/HDFS-11698
             Project: Hadoop HDFS
          Issue Type: Sub-task
          Components: ozone
    Affects Versions: HDFS-7240
            Reporter: Anu Engineer

This is not discussed as part of the standard command line set, since these are internal debug
only commands.

We have levelDB that stores key, value pairs and value is always binary blobs. These binary
blobs can only be decoded using protobuf classes that are part of ozone. 

We would like to add an extension to SCM CLI which allows us to convert levelDB to SQLlite,
since SQLlite would have structured data and standard SQL will work against it. 

The reason to use SQLlite instead of some dump file like json is the scale, it is possible
that some levelDB files will have millions of keys, so having an SQL DB with proper index
will make debugging much easier.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message