phoenix-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Akshita Malhotra (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (PHOENIX-4353) Constraint violation error in Snapshot based index rebuild job
Date Tue, 07 Nov 2017 22:30:02 GMT

     [ https://issues.apache.org/jira/browse/PHOENIX-4353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Akshita Malhotra reassigned PHOENIX-4353:
-----------------------------------------

    Assignee: Akshita Malhotra

> Constraint violation error in Snapshot based index rebuild job
> --------------------------------------------------------------
>
>                 Key: PHOENIX-4353
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-4353
>             Project: Phoenix
>          Issue Type: Bug
>    Affects Versions: 4.13.0
>            Reporter: Monani Mihir
>            Assignee: Akshita Malhotra
>            Priority: Critical
>
> When we try to rebuild index with data table snapshot, many mappers fails with ERROR
218 (23018): Constraint violation. Example below :-
> Cmd to run snapshot based index job :-
> bin/hbase org.apache.phoenix.mapreduce.index.IndexTool -it DATA_INDEX -dt DATA -s SCHEMA
-snap -op /TEST/DATA_INDEX
> Mappers failed with error :-
> {code}
> 2017-11-06 09:25:24,380 INFO  [main] regionserver.HRegion - Onlined eac5484a276e8d942e9eebf8275f114f;
next sequenceid=18399282
> 2017-11-06 09:25:24,522 ERROR [main] index.PhoenixIndexImportMapper - Error ERROR 218
(23018): Constraint violation. SCHEMA.DATA_INDEX.:DATA_ID may not be null  while read/write
of a record 
> 2017-11-06 09:25:24,545 INFO  [42e9eebf8275f114f.-1] regionserver.HStore - Closed 0
> 2017-11-06 09:25:24,546 INFO  [main] regionserver.HRegion - Closed SCHEMA.DATA_INDEX,userID1234orgid1234,1509939061852.eac5484a276e8d942e9eebf8275f114f.
> 2017-11-06 09:25:24,547 INFO  [main] mapred.MapTask - Starting flush of map output
> 2017-11-06 09:25:24,557 INFO  [main] compress.CodecPool - Got brand-new compressor [.snappy]
> 2017-11-06 09:25:24,560 WARN  [main] mapred.YarnChild - Exception running child : java.lang.RuntimeException:
java.sql.SQLException: ERROR 218 (23018): Constraint violation. SCHEMA.DATA_INDEX.:DATA_ID
may not be null
>     at org.apache.phoenix.mapreduce.index.PhoenixIndexImportMapper.map(PhoenixIndexImportMapper.java:122)
>     at org.apache.phoenix.mapreduce.index.PhoenixIndexImportMapper.map(PhoenixIndexImportMapper.java:48)
>     at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
>     at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
>     at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
>     at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:170)
>     at java.security.AccessController.doPrivileged(Native Method)
>     at javax.security.auth.Subject.doAs(Subject.java:422)
>     at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1751)
>     at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:164)
> Caused by: java.sql.SQLException: ERROR 218 (23018): Constraint violation. SCHEMA.DATA_INDEX.:DATA_ID
may not be null
>     at org.apache.phoenix.exception.SQLExceptionCode$Factory$1.newException(SQLExceptionCode.java:488)
>     at org.apache.phoenix.exception.SQLExceptionInfo.buildException(SQLExceptionInfo.java:150)
>     at org.apache.phoenix.schema.ConstraintViolationException.<init>(ConstraintViolationException.java:39)
>     at org.apache.phoenix.schema.PTableImpl.newKey(PTableImpl.java:753)
>     at org.apache.phoenix.compile.UpsertCompiler.setValues(UpsertCompiler.java:154)
>     at org.apache.phoenix.compile.UpsertCompiler.access$500(UpsertCompiler.java:116)
>     at org.apache.phoenix.compile.UpsertCompiler$4.execute(UpsertCompiler.java:1078)
>     at org.apache.phoenix.jdbc.PhoenixStatement$2.call(PhoenixStatement.java:393)
>     at org.apache.phoenix.jdbc.PhoenixStatement$2.call(PhoenixStatement.java:376)
>     at org.apache.phoenix.call.CallRunner.run(CallRunner.java:53)
>     at org.apache.phoenix.jdbc.PhoenixStatement.executeMutation(PhoenixStatement.java:374)
>     at org.apache.phoenix.jdbc.PhoenixStatement.executeMutation(PhoenixStatement.java:363)
>     at org.apache.phoenix.jdbc.PhoenixStatement.execute(PhoenixStatement.java:269)
>     at org.apache.phoenix.jdbc.PhoenixPreparedStatement.execute(PhoenixPreparedStatement.java:172)
>     at org.apache.phoenix.jdbc.PhoenixPreparedStatement.execute(PhoenixPreparedStatement.java:177)
>     at org.apache.phoenix.mapreduce.index.PhoenixIndexImportMapper.map(PhoenixIndexImportMapper.java:101)
>     ... 9 more
> 2017-11-06 09:25:24,563 INFO  [main] mapred.Task - Runnning cleanup for the task
> 2017-11-06 09:25:24,564 WARN  [main] output.FileOutputCommitter - Could not delete hdfs://hdfs-local/TEST/DATA_INDEX/SCHEMA.DATA_INDEX/_temporary/1/_temporary/attempt_1508241002000_5658_m_000014_0
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message