Mailing-List: contact commits-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@cassandra.apache.org
Date: Tue, 19 Sep 2017 16:44:00 +0000 (UTC)
From: "Michael Shuler (JIRA)" <jira@apache.org>
To: commits@cassandra.apache.org
Message-ID: <JIRA.13075104.1495785867000.148708.1505839440830@Atlassian.JIRA>
In-Reply-To: <JIRA.13075104.1495785867000@Atlassian.JIRA>
References: <JIRA.13075104.1495785867000@Atlassian.JIRA> <JIRA.13075104.1495785867428@jira-lw-us.apache.org>
Subject: [jira] [Updated] (CASSANDRA-13556) Corrupted SSTables
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
archived-at: Tue, 19 Sep 2017 16:44:09 -0000


     [ https://issues.apache.org/jira/browse/CASSANDRA-13556?page=3Dcom.atl=
assian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Michael Shuler updated CASSANDRA-13556:
---------------------------------------
    Priority: Major  (was: Critical)

> Corrupted SSTables
> ------------------
>
>                 Key: CASSANDRA-13556
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-1355=
6
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Compaction
>         Environment: CentOS Linux release 7.3.1611 (Core)
> openjdk version "1.8.0_121"
> OpenJDK Runtime Environment (build 1.8.0_121-b13)
> OpenJDK 64-Bit Server VM (build 25.121-b13, mixed mode)
> Python cassandra (DataStax) driver v3.6.0
>            Reporter: Ihor Prokopov
>             Fix For: 3.11.x
>
>
> After 3 month of working, we noticed that number of compaction tasks were=
 growing (~600 pending tasks). SStables verification shows that some of the=
m were corrupted. Repairing didn't help (it was crashing with error).=20
> Also some of requests (f.e. select * from fetcher where domain=3D82895119=
71670945261 and uri=3D-5417197141545933706; ) fails with next error:
> {color:red}
> Traceback (most recent call last):
>   File "/var/cassandra/apache-cassandra-3.9/bin/cqlsh.py", line 1264, in =
perform_simple_statement
>     result =3D future.result()
>   File "/var/cassandra/apache-cassandra-3.9/bin/../lib/cassandra-driver-i=
nternal-only-3.5.0.post0-d8d0456.zip/cassandra-driver-3.5.0.post0-d8d0456/c=
assandra/cluster.py", line 3650, in result
>     raise self._final_exception
> error: unpack requires a string argument of length 4
> {color}
> Table chema:
> {quote}
> CREATE TABLE fetcher (
>     domain bigint,
>     uri bigint,
>     date date,
>     content_length int,
>     elapsed float,
>     encoding text,
>     fetched_time bigint,
>     flinks frozen<set<tuple<bigint, bigint=C2=BB>,
>     flinks_count int,
>     html_fingerprint bigint,
>     indexed boolean,
>     adult boolean,
>     kws_count int,
>     lang_id int,
>     last_updated bigint,
>     redirect_url tuple<bigint, bigint>,
>     revisit_date date,
>     revisit_interval int,
>     status_code int,
>     tokens_fingerprint bigint,
>     uris frozen<set<bigint=C2=BB,
>     url text,
>     PRIMARY KEY (domain, uri, date)
> ) WITH CLUSTERING ORDER BY (uri ASC, date DESC)
>     AND bloom_filter_fp_chance =3D 0.1
>     AND caching =3D \{'keys': 'ALL', 'rows_per_partition': 'NONE'}
>     AND comment =3D 'fetcher history'
>     AND compaction =3D \{'class': 'org.apache.cassandra.db.compaction.Lev=
eledCompactionStrategy',
>                       'sstable_size_in_mb': '256',
>                       'tombstone_threshold': '.2'}
>     AND compression =3D \{'chunk_length_in_kb': '64',
>                        'class': 'org.apache.cassandra.io.compress.LZ4Comp=
ressor'}
>     AND crc_check_chance =3D 1.0
>     AND dclocal_read_repair_chance =3D 0.1
>     AND default_time_to_live =3D 0
>     AND gc_grace_seconds =3D 864000
>     AND max_index_interval =3D 2048
>     AND memtable_flush_period_in_ms =3D 0
>     AND min_index_interval =3D 128
>     AND read_repair_chance =3D 0.5
>     AND speculative_retry =3D '99PERCENTILE';
> {quote}
> Corrupted [SSTable|https://drive.google.com/file/d/0B4ZaUOv0G9oMcHpERTdlb=
3ozSVk/view?usp=3Dsharing].


--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cassandra.apache.org
For additional commands, e-mail: commits-help@cassandra.apache.org