hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Weiwei Yang (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-12504) Ozone: Improve SQLCLI performance
Date Wed, 20 Sep 2017 06:28:01 GMT
Weiwei Yang created HDFS-12504:
----------------------------------

             Summary: Ozone: Improve SQLCLI performance
                 Key: HDFS-12504
                 URL: https://issues.apache.org/jira/browse/HDFS-12504
             Project: Hadoop HDFS
          Issue Type: Sub-task
          Components: ozone
            Reporter: Weiwei Yang


In my test, my {{ksm.db}} has *3017660* entries with total size of *128mb*, SQLCLI tool runs
over *2 hours* but still not finish exporting the DB. This is because it iterates each entry
and inserts that to another sqllite DB file, which is not efficient. We need to improve this
to be running more efficiently on large DB files.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org


Mime
View raw message