drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nathan Griffith (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (DRILL-4063) Missing files/classes needed for S3a access
Date Tue, 10 Nov 2015 22:04:11 GMT

     [ https://issues.apache.org/jira/browse/DRILL-4063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Nathan Griffith updated DRILL-4063:
-----------------------------------
    Description: 
Specifying

{code}
"connection": "s3a://<bucketname>"
{code}

results in the following error:
{code}
Error: SYSTEM ERROR: ClassNotFoundException: Class org.apache.hadoop.fs.s3a.S3AFileSystem
not found
{code}

I can fix this by dropping in these files from the hadoop binary tarball:
hadoop-aws-2.6.2.jar
aws-java-sdk-1.7.4.jar

And then adding this to my core-site.xml:
{code:xml}
  <property>
    <name>fs.s3a.access.key</name>
    <value>ACCESSKEY</value>
  </property>

  <property>
    <name>fs.s3a.secret.key</name>
    <value>SECRETKEY</value>
  </property>
{code}

  was:
Specifying

{code}
"connection": "s3a://<bucketname>"
{code}

results in the following error:
{code}
Error: SYSTEM ERROR: ClassNotFoundException: Class org.apache.hadoop.fs.s3a.S3AFileSystem
not found
{code}

I can fix this by dropping in these files from the hadoop binary tarball:
hadoop-aws-2.6.2.jar
aws-java-sdk-1.7.4.jar

And then adding this to my core-site.xml:
{code:xml}
  <property>
    <name>fs.s3a.access.key</name>
    <value></value>
  </property>

  <property>
    <name>fs.s3a.secret.key</name>
    <value></value>
  </property>
{code}


> Missing files/classes needed for S3a access
> -------------------------------------------
>
>                 Key: DRILL-4063
>                 URL: https://issues.apache.org/jira/browse/DRILL-4063
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Storage - Other
>    Affects Versions: 1.3.0
>         Environment: OS X
>            Reporter: Nathan Griffith
>              Labels: aws, aws-s3, s3, storage
>
> Specifying
> {code}
> "connection": "s3a://<bucketname>"
> {code}
> results in the following error:
> {code}
> Error: SYSTEM ERROR: ClassNotFoundException: Class org.apache.hadoop.fs.s3a.S3AFileSystem
not found
> {code}
> I can fix this by dropping in these files from the hadoop binary tarball:
> hadoop-aws-2.6.2.jar
> aws-java-sdk-1.7.4.jar
> And then adding this to my core-site.xml:
> {code:xml}
>   <property>
>     <name>fs.s3a.access.key</name>
>     <value>ACCESSKEY</value>
>   </property>
>   <property>
>     <name>fs.s3a.secret.key</name>
>     <value>SECRETKEY</value>
>   </property>
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message