cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jeff Jirsa (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CASSANDRA-5791) A nodetool command to validate all sstables in a node
Date Fri, 06 Feb 2015 22:04:36 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-5791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14310025#comment-14310025
] 

Jeff Jirsa commented on CASSANDRA-5791:
---------------------------------------

Duplicating my comment from 8703 here since its a dupe and prone to closure :

I've got a version at https://github.com/jeffjirsa/cassandra/commits/cassandra-8703 that follows
the scrub read path and implements nodetool verify / sstableverify. This works, for both compressed
and uncompressed, but requires walking the entire sstable and verifies each on disk atom.
This works, it just isn't very fast (though it is thorough).
The faster method will be checking against the Digest.sha1 file (which actually contains an
adler32 hash), and skipping the full iteration. I'll rebase and work that in, using the 'walk
all atoms' approach above as an optional extended verify (-e) or similar, unless someone objects.
Also going to rename the DIGEST sstable component to Digest.adler32 since it's definitely
not sha1 anymore.

> A nodetool command to validate all sstables in a node
> -----------------------------------------------------
>
>                 Key: CASSANDRA-5791
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-5791
>             Project: Cassandra
>          Issue Type: New Feature
>          Components: Core
>            Reporter: sankalp kohli
>            Priority: Minor
>
> CUrrently there is no nodetool command to validate all sstables on disk. The only way
to do this is to run a repair and see if it succeeds. But we cannot repair the system keyspace.

> Also we can run upgrade sstables but that re writes all the sstables. 
> This command should check the hash of all sstables and return whether all data is readable
all not. This should NOT care about consistency. 
> The compressed sstables do not have hash so not sure how it will work there.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message