hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jean-Marc Spaggiari (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-16439) Row mutation: missing rows with Put contains thousands of columns
Date Wed, 17 Aug 2016 14:14:20 GMT

    [ https://issues.apache.org/jira/browse/HBASE-16439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15424585#comment-15424585
] 

Jean-Marc Spaggiari commented on HBASE-16439:
---------------------------------------------

Hi Stas,

Reading your code, it seems you try to create 15 000 rows of 5 00 columns. But you are expecting
to see 15 000 columns. Am I reading something badly?

Thanks.

> Row mutation: missing rows with Put contains thousands of columns
> -----------------------------------------------------------------
>
>                 Key: HBASE-16439
>                 URL: https://issues.apache.org/jira/browse/HBASE-16439
>             Project: HBase
>          Issue Type: Bug
>          Components: hbase
>    Affects Versions: 0.98.6
>         Environment: Cloudera CDH 5.3.3
>            Reporter: Stas Makutin
>         Attachments: HBaseAtomic.zip
>
>
> Some rows is missing when put them into a table using mutateRow method and each row has
thousands of columns. The code excerpt:
> {code}
> try (HConnection hc = HConnectionManager.createConnection(conf)) {
> 	try (HTableInterface table = hc.getTable(tableName)) {
> 		final LocalDate startDate = LocalDate.of(1980, 01, 01); 
> 		for (int i = 0; i < 15000; i++) {
> 			byte[] row = Bytes.toBytes(Integer.toString(i));
> 			long ts = System.currentTimeMillis();
> 			Put put = new Put(row, ts + 1);
> 			LocalDate date = startDate; 
> 			for (int j = 0; j < 5000; j++) {
> 				put.add(
> 					family,
> 					Bytes.toBytes(DateTimeFormatter.BASIC_ISO_DATE.format(date)),
> 					Bytes.toBytes(Integer.toString(j))
> 				);
> 				date = date.plusDays(1);
> 			}
> 			
> 			RowMutations rm = new RowMutations(row);
> 			rm.add(put);
> 			
> 			table.mutateRow(rm);
> 		}
> 	}
> }
> {code}
> Resulting number of columns varies - sometimes it 200, sometimes it 8000. But never expected
15000.
> The full code of test application is attached.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message