cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jonathan Ellis <jbel...@gmail.com>
Subject Re: Query on sstable2json - possible bug
Date Wed, 06 Oct 2010 23:43:07 GMT
can you tar.gz the filter/index/data files for this sstable and attach
it to a ticket so we can debug?

if you can't make the data public you can send it to me off list and I
can have a look.

On Wed, Oct 6, 2010 at 11:37 AM, Narendra Sharma
<narendra.sharma@gmail.com> wrote:
> Has any one used sstable2json on 0.6.5 and noticed the issue I described in
> my email below? This doesn't look like data corruption issue as sstablekeys
> shows the keys.
>
> Thanks,
> Naren
>
>
> On Tue, Oct 5, 2010 at 8:09 PM, Narendra Sharma <narendra.sharma@gmail.com>
> wrote:
>>
>> 0.6.5
>>
>> -Naren
>>
>> On Tue, Oct 5, 2010 at 6:56 PM, Jonathan Ellis <jbellis@gmail.com> wrote:
>>>
>>> Version?
>>>
>>> On Tue, Oct 5, 2010 at 7:28 PM, Narendra Sharma
>>> <narendra.sharma@gmail.com> wrote:
>>> > Hi,
>>> >
>>> > I am using sstable2json to extract row data for debugging some
>>> > application
>>> > issue. I first ran sstablekeys to find the list of keys in the sstable.
>>> > Then
>>> > I use the key to fetch row from sstable. The sstable is from Lucandra
>>> > deployment. I get following.
>>> >
>>> > -bash-3.2$ ./sstablekeys Documents-37-Data.db | more
>>> > jhwKcHZx���0df5a54a-61d8-440e-94a9-b46061ba2fec
>>> > jhwKcHZx���120fc562-cf9f-4204-963d-0ed0d8cd2d09
>>> > jhwKcHZx���93d78bce-7713-4ff9-bc83-b02663a1a55c
>>> > jhwKcHZx���e6f6f5ef-a09f-4e84-9727-56867e81be00
>>> > jqCF6zxM���04f2f4da-724d-40f1-95bf-4799b97ade76
>>> > jqCF6zxM���917f66a6-7a95-4789-82ca-aaa511f6b56e
>>> >
>>> > //This returns correct data
>>> > -bash-3.2$ ./sstable2json Documents-38-Data.db -k
>>> > jhwKcHZx���0df5a54a-61d8-440e-94a9-b46061ba2fec
>>> > {
>>> >   "jhwKcHZx���0df5a54a-61d8-440e-94a9-b46061ba2fec": [["5f3a46514944",
>>> >
>>> > "30646635613534612d363164382d343430652d393461392d62343630363162613266656380",
>>> > 1296272041356884, false], ["5f3a504152454e54",
>>> >
>>> > "65373466316138632d313934652d343939652d383835362d64316536343939613862636180",
>>> > 1296272041369884, false], ["5f3a55554944",
>>> >
>>> > "30646635613534612d363164382d343430652d393461392d62343630363162613266656380",
>>> > 1296272041342884, false], ["efbfbf4d455441efbfbf",
>>> >
>>> > "aced0005737200136a6176612e7574696c2e41727261794c6973747881d21d99c7619d03000149000473697a6578700000000677040000000a74002d5f3a55554944efbfbf30646635613534612d363164382d343430652d393461392d62343630363162613266656374002d5f3a46514944efbfbf30646635613534612d363164382d343430652d393461392d62343630363162613266656374002f5f3a504152454e54efbfbf65373466316138632d313934652d343939652d383835362d643165363439396138626361740032313a76706172656e746964efbfbf65373466316138632d313934652d343939652d383835362d64316536343939613862636174000e333a6e616d65efbfbf656d61696c740016333a7072696d61727954797065efbfbf31313a61707078",
>>> > 1296272041458884, false]]
>>> > }
>>> >
>>> > //Look at the key in the json output. It doesn't match the key passed
>>> > as
>>> > argument
>>> > -bash-3.2$ ./sstable2json Documents-38-Data.db -k
>>> > jhwKcHZx���120fc562-cf9f-4204-963d-0ed0d8cd2d09
>>> > {
>>> >   "jhwKcHZx���0df5a54a-61d8-440e-94a9-b46061ba2fec": [["5f3a46514944",
>>> >
>>> > "30646635613534612d363164382d343430652d393461392d62343630363162613266656380",
>>> > 1296272041356884, false], ["5f3a504152454e54",
>>> >
>>> > "65373466316138632d313934652d343939652d383835362d64316536343939613862636180",
>>> > 1296272041369884, false], ["5f3a55554944",
>>> >
>>> > "30646635613534612d363164382d343430652d393461392d62343630363162613266656380",
>>> > 1296272041342884, false], ["efbfbf4d455441efbfbf",
>>> >
>>> > "aced0005737200136a6176612e7574696c2e41727261794c6973747881d21d99c7619d03000149000473697a6578700000000677040000000a74002d5f3a55554944efbfbf30646635613534612d363164382d343430652d393461392d62343630363162613266656374002d5f3a46514944efbfbf30646635613534612d363164382d343430652d393461392d62343630363162613266656374002f5f3a504152454e54efbfbf65373466316138632d313934652d343939652d383835362d643165363439396138626361740032313a76706172656e746964efbfbf65373466316138632d313934652d343939652d383835362d64316536343939613862636174000e333a6e616d65efbfbf656d61696c740016333a7072696d61727954797065efbfbf31313a61707078",
>>> > 1296272041458884, false]]
>>> > }
>>> > -bash-3.2$
>>> >
>>> > //This returns correct data
>>> > -bash-3.2$ ./sstable2json Documents-38-Data.db -k
>>> > jqCF6zxM���04f2f4da-724d-40f1-95bf-4799b97ade76
>>> > {
>>> >   "jqCF6zxM���04f2f4da-724d-40f1-95bf-4799b97ade76":
>>> > [["31313a6d73732e626c6f622e73697a65", "3733333780", 1296278215537884,
>>> > false], ["31313a6d73732e6d73672e3173742e7365656e2e73656373", "3080",
>>> > 1296278215526884, false], ["31313a6d73732e6d73672e61727674696d65",
>>> > "3132383632363630373180", 1296278215627884, false],
>>> > ["31313a6d73732e6d73672e626f756e6365", "66616c736580",
>>> > 1296278215653884,
>>> > false], ["31313a6d73732e6d73672e64656c2e6e6472", "66616c736580",
>>> > 1296278215543884, false], ["31313a6d73732e6d73672e6578702e73656373",
>>> > "3080",
>>> > 1296278215549884, false], ["31313a6d73732e6d73672e666c616773", "3080",
>>> > 1296278215679884, false], ["31313a6d73732e6d73672e6964",
>>> >
>>> > "30346632663464612d373234642d343066312d393562662d34373939623937616465373680",
>>> > 1296278215673884, false], ["31313a6d73732e6d73672e6b6579776f726473",
>>> > "80",
>>> > 1296278215520884, false], ["31313a6d73732e6d73672e6c6173745f616363",
>>> > "3080",
>>> > 1296278215569884, false],
>>> > ["31313a6d73732e6d73672e6d756c7469706c652e6d736773", "46c2900ec3a780",
>>> > 1296278215691884, false], ["31313a6d73732e6d73672e7072696f72", "80",
>>> > 1296278215697884, false], ["31313a6d73732e6d73672e70726976617465",
>>> > "66616c736580", 1296278215592884, false],
>>> > ["31313a6d73732e6d73672e73697a65",
>>> > "3636383180", 1296278215532884, false],
>>> > ["31313a6d73732e6d73672e74696d65317374616363", "3080",
>>> > 1296278215647884,
>>> > false], ["31313a6d73732e6d73672e74797065", "80", 1296278215685884,
>>> > false],
>>> > ["31313a6d73732e6d73672e756964", "3130303480", 1296278215563884,
>>> > false],
>>> > ["31313a6d73732e6d73672e756e72656164", "7472756580", 1296278215659884,
>>> > false], ["31313a6d73732e766572", "3080", 1296278215633884, false],
>>> > ["5f3a46514944",
>>> >
>>> > "30346632663464612d373234642d343066312d393562662d34373939623937616465373680",
>>> > 1296278215500884, false], ["5f3a504152454e54",
>>> >
>>> > "62646638666262622d323265392d343830302d623533612d35373032333838303436616680",
>>> > 1296278215514884, false], ["5f3a55554944",
>>> >
>>> > "30346632663464612d373234642d343066312d393562662d34373939623937616465373680",
>>> > 1296278215486884, false], ["efbfbf4d455441efbfbf",
>>> >
>>> > "aced0005737200136a6176612e7574696c2e41727261794c6973747881d21d99c7619d03000149000473697a6578700000000a77040000000a74002d5f3a55554944efbfbf30346632663464612d373234642d343066312d393562662d34373939623937616465373674002d5f3a46514944efbfbf30346632663464612d373234642d343066312d393562662d34373939623937616465373674002f5f3a504152454e54efbfbf62646638666262622d323265392d343830302d623533612d35373032333838303436616674001531313a6d73732e6d73672e756964efbfbf31303034740032313a76706172656e746964efbfbf36333131386266362d643334302d343837392d383837642d66356531393731336635653574001e333a6d6978696e5479706573efbfbf353a7265666572656e636561626c65740035313a76616e636573746f72736964efbfbf39323961306162612d383237372d343433312d626136342d383833643933623631613335740035313a76616e636573746f72736964efbfbf64326133356631312d383833612d343064312d626632362d666335613434663439373865740017333a7072696d61727954797065efbfbf31313a6974656d74003431313a6d73732e6d73672e6964efbfbf30346632663464612d373234642d343066312d393562662d34373939623937616465373678",
>>> > 1296278215785884, false]]
>>> > }
>>> >
>>> > //XXXXXX is not a valid key in my sstable
>>> > -bash-3.2$ ./sstable2json
>>> > /u3/cassandra/data/ScratIndex/Documents-38-Data.db
>>> > -k XXXXXX
>>> > {
>>> >   "jgKp4iw0���c6643d3f-fbe3-43a2-99a4-7a347f6a6da0":
>>> > [["31313a6d73732e626c6f622e73697a65", "3331323380", 1256305183229367,
>>> > false], ["31313a6d73732e6d73672e3173742e7365656e2e73656373", "3080",
>>> > 1256305183224367, false], ["31313a6d73732e6d73672e61727674696d65",
>>> > "3132383632373730353580", 1256305183308367, false],
>>> > ["31313a6d73732e6d73672e626f756e6365", "66616c736580",
>>> > 1256305183326367,
>>> > false], ["31313a6d73732e6d73672e64656c2e6e6472", "66616c736580",
>>> > 1256305183240367, false], ["31313a6d73732e6d73672e6578702e73656373",
>>> > "3080",
>>> > 1256305183245367, false], ["31313a6d73732e6d73672e666c616773", "3180",
>>> > 1256305183337367, false], ["31313a6d73732e6d73672e6964",
>>> >
>>> > "63363634336433662d666265332d343361322d393961342d37613334376636613664613080",
>>> > 1256305183350367, false], ["31313a6d73732e6d73672e6b6579776f726473",
>>> > "80",
>>> > 1256305183219367, false], ["31313a6d73732e6d73672e6c6173745f616363",
>>> > "3080",
>>> > 1256305183262367, false],
>>> > ["31313a6d73732e6d73672e6d756c7469706c652e6d736773", "4680",
>>> > 1256305183362367, false], ["31313a6d73732e6d73672e7072696f72", "80",
>>> > 1256305183367367, false], ["31313a6d73732e6d73672e70726976617465",
>>> > "66616c736580", 1256305183274367, false],
>>> > ["31313a6d73732e6d73672e73697a65",
>>> > "3235343380", 1256305183235367, false],
>>> > ["31313a6d73732e6d73672e74696d65317374616363", "3080",
>>> > 1256305183321367,
>>> > false], ["31313a6d73732e6d73672e74797065", "80", 1256305183356367,
>>> > false],
>>> > ["31313a6d73732e6d73672e756964", "3130303780", 1256305183257367,
>>> > false],
>>> > ["31313a6d73732e6d73672e756e72656164", "7472756580", 1256305183331367,
>>> > false], ["31313a6d73732e766572", "3080", 1256305183302367, false],
>>> > ["5f3a46514944",
>>> >
>>> > "63363634336433662d666265332d343361322d393961342d37613334376636613664613080",
>>> > 1256305183202367, false], ["5f3a504152454e54",
>>> >
>>> > "30656365383930332d313162652d343934362d396136342d62663230323537313336643180",
>>> > 1256305183214367, false], ["5f3a55554944",
>>> >
>>> > "63363634336433662d666265332d343361322d393961342d37613334376636613664613080",
>>> > 1256305183191367, false], ["efbfbf4d455441efbfbf",
>>> >
>>> > "aced0005737200136a6176612e7574696c2e41727261794c6973747881d21d99c7619d03000149000473697a6578700000000a77040000000a74002d5f3a55554944efbfbf63363634336433662d666265332d343361322d393961342d37613334376636613664613074002d5f3a46514944efbfbf63363634336433662d666265332d343361322d393961342d37613334376636613664613074002f5f3a504152454e54efbfbf30656365383930332d313162652d343934362d396136342d62663230323537313336643174001531313a6d73732e6d73672e756964efbfbf31303037740032313a76706172656e746964efbfbf64633766656164642d663634652d346165362d613763352d36343637396238373331313874001e333a6d6978696e5479706573efbfbf353a7265666572656e636561626c65740035313a76616e636573746f72736964efbfbf62353334393064312d333665352d343539632d623839632d383862323635323161363463740035313a76616e636573746f72736964efbfbf65616232323639642d353935372d346130312d623666392d666162656230376339623433740017333a7072696d61727954797065efbfbf31313a6974656d74003431313a6d73732e6d73672e6964efbfbf63363634336433662d666265332d343361322d393961342d37613334376636613664613078",
>>> > 1256305183396367, false]]
>>> > }
>>> > -bash-3.2$
>>> >
>>> > What is wrong here?  Is this a bug in sstable2json?
>>> >
>>> > Thanks,
>>> > Naren
>>> >
>>>
>>>
>>>
>>> --
>>> Jonathan Ellis
>>> Project Chair, Apache Cassandra
>>> co-founder of Riptano, the source for professional Cassandra support
>>> http://riptano.com
>>
>
>



-- 
Jonathan Ellis
Project Chair, Apache Cassandra
co-founder of Riptano, the source for professional Cassandra support
http://riptano.com

Mime
View raw message