phoenix-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Monani Mihir (JIRA)" <j...@apache.org>
Subject [jira] [Created] (PHOENIX-4353) Constraint violation error in Snapshot based index rebuild job
Date Tue, 07 Nov 2017 12:34:00 GMT
Monani Mihir created PHOENIX-4353:
-------------------------------------

             Summary: Constraint violation error in Snapshot based index rebuild job
                 Key: PHOENIX-4353
                 URL: https://issues.apache.org/jira/browse/PHOENIX-4353
             Project: Phoenix
          Issue Type: Bug
    Affects Versions: 4.13.0
            Reporter: Monani Mihir
            Priority: Critical


When we try to rebuild index with data table snapshot, many mappers fails with ERROR 218 (23018):
Constraint violation. Example below :-

Cmd to run snapshot based index job :-
bin/hbase org.apache.phoenix.mapreduce.index.IndexTool -it DATA_INDEX -dt DATA -s SCHEMA -snap
-op /TEST/DATA_INDEX

Mappers failed with error :-

2017-11-06 09:25:24,380 INFO  [main] regionserver.HRegion - Onlined eac5484a276e8d942e9eebf8275f114f;
next sequenceid=18399282
2017-11-06 09:25:24,522 ERROR [main] index.PhoenixIndexImportMapper - Error ERROR 218 (23018):
Constraint violation. SCHEMA.DATA_INDEX.:DATA_ID may not be null  while read/write of a record

2017-11-06 09:25:24,545 INFO  [42e9eebf8275f114f.-1] regionserver.HStore - Closed 0
2017-11-06 09:25:24,546 INFO  [main] regionserver.HRegion - Closed SCHEMA.DATA_INDEX,userID1234orgid1234,1509939061852.eac5484a276e8d942e9eebf8275f114f.
2017-11-06 09:25:24,547 INFO  [main] mapred.MapTask - Starting flush of map output
2017-11-06 09:25:24,557 INFO  [main] compress.CodecPool - Got brand-new compressor [.snappy]
2017-11-06 09:25:24,560 WARN  [main] mapred.YarnChild - Exception running child : java.lang.RuntimeException:
java.sql.SQLException: ERROR 218 (23018): Constraint violation. SCHEMA.DATA_INDEX.:DATA_ID
may not be null
    at org.apache.phoenix.mapreduce.index.PhoenixIndexImportMapper.map(PhoenixIndexImportMapper.java:122)
    at org.apache.phoenix.mapreduce.index.PhoenixIndexImportMapper.map(PhoenixIndexImportMapper.java:48)
    at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
    at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
    at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:170)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:422)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1751)
    at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:164)
Caused by: java.sql.SQLException: ERROR 218 (23018): Constraint violation. SCHEMA.DATA_INDEX.:DATA_ID
may not be null
    at org.apache.phoenix.exception.SQLExceptionCode$Factory$1.newException(SQLExceptionCode.java:488)
    at org.apache.phoenix.exception.SQLExceptionInfo.buildException(SQLExceptionInfo.java:150)
    at org.apache.phoenix.schema.ConstraintViolationException.<init>(ConstraintViolationException.java:39)
    at org.apache.phoenix.schema.PTableImpl.newKey(PTableImpl.java:753)
    at org.apache.phoenix.compile.UpsertCompiler.setValues(UpsertCompiler.java:154)
    at org.apache.phoenix.compile.UpsertCompiler.access$500(UpsertCompiler.java:116)
    at org.apache.phoenix.compile.UpsertCompiler$4.execute(UpsertCompiler.java:1078)
    at org.apache.phoenix.jdbc.PhoenixStatement$2.call(PhoenixStatement.java:393)
    at org.apache.phoenix.jdbc.PhoenixStatement$2.call(PhoenixStatement.java:376)
    at org.apache.phoenix.call.CallRunner.run(CallRunner.java:53)
    at org.apache.phoenix.jdbc.PhoenixStatement.executeMutation(PhoenixStatement.java:374)
    at org.apache.phoenix.jdbc.PhoenixStatement.executeMutation(PhoenixStatement.java:363)
    at org.apache.phoenix.jdbc.PhoenixStatement.execute(PhoenixStatement.java:269)
    at org.apache.phoenix.jdbc.PhoenixPreparedStatement.execute(PhoenixPreparedStatement.java:172)
    at org.apache.phoenix.jdbc.PhoenixPreparedStatement.execute(PhoenixPreparedStatement.java:177)
    at org.apache.phoenix.mapreduce.index.PhoenixIndexImportMapper.map(PhoenixIndexImportMapper.java:101)
    ... 9 more

2017-11-06 09:25:24,563 INFO  [main] mapred.Task - Runnning cleanup for the task
2017-11-06 09:25:24,564 WARN  [main] output.FileOutputCommitter - Could not delete hdfs://hdfs-local/TEST/DATA_INDEX/SCHEMA.DATA_INDEX/_temporary/1/_temporary/attempt_1508241002000_5658_m_000014_0



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message