atlas-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Suma Shivaprasad (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (ATLAS-861) 1 table out of 50,000 tables is left unimported throwing exception during deserialization
Date Thu, 28 Jul 2016 21:46:20 GMT

     [ https://issues.apache.org/jira/browse/ATLAS-861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Suma Shivaprasad updated ATLAS-861:
-----------------------------------
    Attachment: ATLAS-861.patch

Changed for the formatter from SimpleDateFormat to joda DateTimeFormatter for both convert
and output. 

> 1 table out of 50,000 tables is left unimported throwing exception during deserialization
> -----------------------------------------------------------------------------------------
>
>                 Key: ATLAS-861
>                 URL: https://issues.apache.org/jira/browse/ATLAS-861
>             Project: Atlas
>          Issue Type: Bug
>         Environment: Atlas commit id : 59268875d256c92f748198cea999ed5057c6bf18
> Cluster setup :
> Machine 1 : Atlas, Solr
> Machine 2 : HBase, Kafka
> Machine 3 : Client
> atlas.notification.hook.numthreads=5
> ATLAS_HOOK topic created with 5 partitions
>            Reporter: Sharmadha Sainath
>         Attachments: ATLAS-861.patch, Kakfa Message table_7770.rtf
>
>
> On importing 50,000 tables using hiveserver2, 1 table is not imported (table_7770). Below
is the exception stack trace :
> java.lang.NumberFormatException: For input string: ""
> 	at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
> 	at java.lang.Long.parseLong(Long.java:453)
> 	at java.lang.Long.parseLong(Long.java:483)
> 	at java.text.DigitList.getLong(DigitList.java:194)
> 	at java.text.DecimalFormat.parse(DecimalFormat.java:1316)
> 	at java.text.SimpleDateFormat.subParse(SimpleDateFormat.java:1793)
> 	at java.text.SimpleDateFormat.parse(SimpleDateFormat.java:1455)
> 	at java.text.DateFormat.parse(DateFormat.java:355)
> 	at org.apache.atlas.typesystem.types.DataTypes$DateType.convert(DataTypes.java:415)
> 	at org.apache.atlas.typesystem.types.DataTypes$DateType.convert(DataTypes.java:400)
> 	at org.apache.atlas.typesystem.persistence.StructInstance.set(StructInstance.java:121)
> 	at org.apache.atlas.typesystem.types.ClassType.convert(ClassType.java:143)
> 	at org.apache.atlas.services.DefaultMetadataService.getTypedReferenceableInstance(DefaultMetadataService.java:356)
> 	at org.apache.atlas.services.DefaultMetadataService.deserializeClassInstances(DefaultMetadataService.java:332)
> 	at org.apache.atlas.services.DefaultMetadataService.updateEntities(DefaultMetadataService.java:426)
> 	at org.apache.atlas.web.resources.EntityResource.updateEntities(EntityResource.java:167)
> 	at org.apache.atlas.LocalAtlasClient$2.invoke(LocalAtlasClient.java:97)
> 	at org.apache.atlas.LocalAtlasClient$EntityOperation.run(LocalAtlasClient.java:118)
> 	at org.apache.atlas.LocalAtlasClient.updateEntities(LocalAtlasClient.java:100)
> 	at org.apache.atlas.AtlasClient.updateEntities(AtlasClient.java:684)
> 	at org.apache.atlas.notification.NotificationHookConsumer$HookConsumer.handleMessage(NotificationHookConsumer.java:225)
> 	at org.apache.atlas.notification.NotificationHookConsumer$HookConsumer.run(NotificationHookConsumer.java:187)
> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-06-03 05:59:28,049 ERROR - [NotificationHookConsumer thread-1:] ~ Unable to persist
entity instance (EntityResource:177)
> java.lang.IllegalArgumentException: Unable to deserialize json
> 	at org.apache.atlas.services.DefaultMetadataService.deserializeClassInstances(DefaultMetadataService.java:340)
> 	at org.apache.atlas.services.DefaultMetadataService.updateEntities(DefaultMetadataService.java:426)
> 	at org.apache.atlas.web.resources.EntityResource.updateEntities(EntityResource.java:167)
> 	at org.apache.atlas.LocalAtlasClient$2.invoke(LocalAtlasClient.java:97)
> 	at org.apache.atlas.LocalAtlasClient$EntityOperation.run(LocalAtlasClient.java:118)
> 	at org.apache.atlas.LocalAtlasClient.updateEntities(LocalAtlasClient.java:100)
> 	at org.apache.atlas.AtlasClient.updateEntities(AtlasClient.java:684)
> 	at org.apache.atlas.notification.NotificationHookConsumer$HookConsumer.handleMessage(NotificationHookConsumer.java:225)
> 	at org.apache.atlas.notification.NotificationHookConsumer$HookConsumer.run(NotificationHookConsumer.java:187)
> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> 	at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.NumberFormatException: For input string: ""



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message