cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Henning Kropp (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (CASSANDRA-7083) Authentication Support for CqlRecordWriter
Date Thu, 24 Apr 2014 14:11:18 GMT

     [ https://issues.apache.org/jira/browse/CASSANDRA-7083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Henning Kropp updated CASSANDRA-7083:
-------------------------------------

    Description: 
The {{CqlRecordWriter}} seems not to support authentication. When the keyspace in Cassandra
is to set to use authentication our Pig job fails with, when credentials are provided using
the URI ('cql://username:password...):
{code}
java.lang.RuntimeException: InvalidRequestException(why:You have not logged in)
	at org.apache.cassandra.hadoop.cql3.CqlRecordWriter.(CqlRecordWriter.java:123)
	at org.apache.cassandra.hadoop.cql3.CqlRecordWriter.(CqlRecordWriter.java:90)
	at org.apache.cassandra.hadoop.cql3.CqlOutputFormat.getRecordWriter(CqlOutputFormat.java:76)
	at org.apache.cassandra.hadoop.cql3.CqlOutputFormat.getRecordWriter(CqlOutputFormat.java:57)
	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.getRecordWriter(PigOutputFormat.java:84)
	at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:553)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
	at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: InvalidRequestException(why:You have not logged in)
	at org.apache.cassandra.thrift.Cassandra$execute_cql3_query_result.read(Cassandra.java:38677)
	at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:78)
	at org.apache.cassandra.thrift.Cassandra$Client.recv_execute_cql3_query(Cassandra.java:1597)
	at org.apache.cassandra.thrift.Cassandra$Client.execute_cql3_query(Cassandra.java:1582)
	at org.apache.cassandra.hadoop.cql3.CqlRecordWriter.retrievePartitionKeyValidator(CqlRecordWriter.java:332)
	at org.apache.cassandra.hadoop.cql3.CqlRecordWriter.(CqlRecordWriter.java:108)
	... 7 more
{code}

If not supplied in the URI but as only in the {{JobConf}} the exception is:
{code}
Output Location Validation Failed for: 'cql://...' More info to follow:
InvalidRequestException(why:You have not logged in)
        at org.apache.pig.newplan.logical.rules.InputOutputFileValidator$
{code}

Which let to the finding, that authentication is correctly supplied for {{CqlStorage}} but
not for the {{CqlRecordWriter}}.

Maybe it would make sense to put the authentication part into {{ConfigHelper.getClientFromAddressList()}}?
Then in {{CqlStorage} the username and password in the conf would need to be set from the
URI. If so the {{ConfigHelper}} has all the information to authenticate and already returns
the client.

  was:
The {{CqlRecordWriter}} seems not to support authentication. When the keyspace in Cassandra
is to set to use authentication our Pig job fails with, when credentials are provided using
the URI ('cql://username:password...):
{code}
java.lang.RuntimeException: InvalidRequestException(why:You have not logged in)
	at org.apache.cassandra.hadoop.cql3.CqlRecordWriter.(CqlRecordWriter.java:123)
	at org.apache.cassandra.hadoop.cql3.CqlRecordWriter.(CqlRecordWriter.java:90)
	at org.apache.cassandra.hadoop.cql3.CqlOutputFormat.getRecordWriter(CqlOutputFormat.java:76)
	at org.apache.cassandra.hadoop.cql3.CqlOutputFormat.getRecordWriter(CqlOutputFormat.java:57)
	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.getRecordWriter(PigOutputFormat.java:84)
	at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:553)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
	at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: InvalidRequestException(why:You have not logged in)
	at org.apache.cassandra.thrift.Cassandra$execute_cql3_query_result.read(Cassandra.java:38677)
	at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:78)
	at org.apache.cassandra.thrift.Cassandra$Client.recv_execute_cql3_query(Cassandra.java:1597)
	at org.apache.cassandra.thrift.Cassandra$Client.execute_cql3_query(Cassandra.java:1582)
	at org.apache.cassandra.hadoop.cql3.CqlRecordWriter.retrievePartitionKeyValidator(CqlRecordWriter.java:332)
	at org.apache.cassandra.hadoop.cql3.CqlRecordWriter.(CqlRecordWriter.java:108)
	... 7 more
{code}

If not supplied in the URI but as only in the {{JobConf}} the exception is:
{code}
Output Location Validation Failed for: 'cql://...' More info to follow:
InvalidRequestException(why:You have not logged in)
        at org.apache.pig.newplan.logical.rules.InputOutputFileValidator$
{code}

Which let to the finding, that authentication is correctly supplied for {{CqlStorage}} but
not for the {{CqlRecordWriter}}.

May be it would make sense to put the authentication part into {{ConfigHelper.getClientFromAddressList()}}?
Then in {{CqlStorage} the username and password in the conf would need to be set from the
URI. If so the {{ConfigHelper}} has all the information to authenticate and already returns
the client.


> Authentication Support for CqlRecordWriter
> ------------------------------------------
>
>                 Key: CASSANDRA-7083
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-7083
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Hadoop
>            Reporter: Henning Kropp
>              Labels: authentication, pig
>         Attachments: auth_cql.patch
>
>
> The {{CqlRecordWriter}} seems not to support authentication. When the keyspace in Cassandra
is to set to use authentication our Pig job fails with, when credentials are provided using
the URI ('cql://username:password...):
> {code}
> java.lang.RuntimeException: InvalidRequestException(why:You have not logged in)
> 	at org.apache.cassandra.hadoop.cql3.CqlRecordWriter.(CqlRecordWriter.java:123)
> 	at org.apache.cassandra.hadoop.cql3.CqlRecordWriter.(CqlRecordWriter.java:90)
> 	at org.apache.cassandra.hadoop.cql3.CqlOutputFormat.getRecordWriter(CqlOutputFormat.java:76)
> 	at org.apache.cassandra.hadoop.cql3.CqlOutputFormat.getRecordWriter(CqlOutputFormat.java:57)
> 	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.getRecordWriter(PigOutputFormat.java:84)
> 	at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:553)
> 	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: InvalidRequestException(why:You have not logged in)
> 	at org.apache.cassandra.thrift.Cassandra$execute_cql3_query_result.read(Cassandra.java:38677)
> 	at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:78)
> 	at org.apache.cassandra.thrift.Cassandra$Client.recv_execute_cql3_query(Cassandra.java:1597)
> 	at org.apache.cassandra.thrift.Cassandra$Client.execute_cql3_query(Cassandra.java:1582)
> 	at org.apache.cassandra.hadoop.cql3.CqlRecordWriter.retrievePartitionKeyValidator(CqlRecordWriter.java:332)
> 	at org.apache.cassandra.hadoop.cql3.CqlRecordWriter.(CqlRecordWriter.java:108)
> 	... 7 more
> {code}
> If not supplied in the URI but as only in the {{JobConf}} the exception is:
> {code}
> Output Location Validation Failed for: 'cql://...' More info to follow:
> InvalidRequestException(why:You have not logged in)
>         at org.apache.pig.newplan.logical.rules.InputOutputFileValidator$
> {code}
> Which let to the finding, that authentication is correctly supplied for {{CqlStorage}}
but not for the {{CqlRecordWriter}}.
> Maybe it would make sense to put the authentication part into {{ConfigHelper.getClientFromAddressList()}}?
Then in {{CqlStorage} the username and password in the conf would need to be set from the
URI. If so the {{ConfigHelper}} has all the information to authenticate and already returns
the client.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message