hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Weiwei Yang (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-12504) Ozone: Improve SQLCLI performance
Date Wed, 20 Sep 2017 06:28:01 GMT
Weiwei Yang created HDFS-12504:

             Summary: Ozone: Improve SQLCLI performance
                 Key: HDFS-12504
                 URL: https://issues.apache.org/jira/browse/HDFS-12504
             Project: Hadoop HDFS
          Issue Type: Sub-task
          Components: ozone
            Reporter: Weiwei Yang

In my test, my {{ksm.db}} has *3017660* entries with total size of *128mb*, SQLCLI tool runs
over *2 hours* but still not finish exporting the DB. This is because it iterates each entry
and inserts that to another sqllite DB file, which is not efficient. We need to improve this
to be running more efficiently on large DB files.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org

View raw message