spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Pratyaksh Sharma <pratyaksh.sharma.ec...@itbhu.ac.in>
Subject [Spark Core] - Spark dynamoDB integration
Date Mon, 12 Dec 2016 11:03:04 GMT
Hey I am using Apache Spark for one streaming application. I am trying to
store the processed data into dynamodb using java sdk. Getting the
following exception -
16/12/08 23:23:43 WARN TaskSetManager: Lost task 0.0 in stage 1.0:
java.lang.NoSuchMethodError: com.amazonaws.SDKGlobalConfigu
ration.isInRegionOptimizedModeEnabled()Z
at com.amazonaws.ClientConfigurationFactory.getConfig(ClientCon
figurationFactory.java:35)
at com.amazonaws.services.dynamodbv2.AmazonDynamoDBClient.<
init>(AmazonDynamoDBClient.java:374)

Spark version - 1.6.1
Scala version - 2.10.5
aws sdk version - 1.11.33

Has anyone faced this issues? Any help will be highly appreciated.

-- 
Regards

Pratyaksh Sharma
12105EN013
Department of Electronics Engineering
IIT Varanasi
Contact No +91-8127030223

Mime
View raw message