Mailing-List: contact commits-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@cassandra.apache.org
Date: Sat, 4 Feb 2012 19:45:54 +0000 (UTC)
From: "Brandon Williams (Resolved) (JIRA)" <jira@apache.org>
To: commits@cassandra.apache.org
Message-ID: 
 <1086147028.11816.1328384754952.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: 
 <714125215.11400.1328363033534.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Resolved] (CASSANDRA-3851) Wrong Keyspace name is generated
 while streaming the sstables using BulkOutputFormat.
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


     [ https://issues.apache.org/jira/browse/CASSANDRA-3851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Brandon Williams resolved CASSANDRA-3851.
-----------------------------------------

    Resolution: Not A Problem

Right, when CASSANDRA-3828 is resolved, it will get merged into 1.1 so this won't be an issue.
                
> Wrong Keyspace name is generated while streaming the sstables using BulkOutputFormat.
> -------------------------------------------------------------------------------------
>
>                 Key: CASSANDRA-3851
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-3851
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Hadoop, Tools
>    Affects Versions: 1.1
>            Reporter: Samarth Gahire
>            Assignee: Brandon Williams
>            Priority: Minor
>              Labels: bulkloader, hadoop, sstableloader
>             Fix For: 1.1
>
>   Original Estimate: 48h
>  Remaining Estimate: 48h
>
> I have merge the committed changes of [CASSANDRA-3828|https://issues.apache.org/jira/browse/CASSANDRA-3828] into my cassadra-trunk. Also the changes for the OutputLocation.
> But when I tried to load the sstables with hadoop job it results into the following exception:
> {code}
> 12/02/04 11:19:12 INFO mapred.JobClient:  map 6% reduce 0%
> 12/02/04 11:19:14 INFO mapred.JobClient: Task Id : attempt_201202041114_0001_m_000001_1, Status : FAILED
> java.lang.RuntimeException: Could not retrieve endpoint ranges:
>         at org.apache.cassandra.hadoop.BulkRecordWriter$ExternalClient.init(BulkRecordWriter.java:252)
>         at org.apache.cassandra.io.sstable.SSTableLoader.stream(SSTableLoader.java:117)
>         at org.apache.cassandra.io.sstable.SSTableLoader.stream(SSTableLoader.java:112)
>         at org.apache.cassandra.hadoop.BulkRecordWriter.close(BulkRecordWriter.java:182)
>         at org.apache.cassandra.hadoop.BulkRecordWriter.close(BulkRecordWriter.java:167)
>         at org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.close(MapTask.java:650)
>         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:765)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:369)
>         at org.apache.hadoop.mapred.Child$4.run(Child.java:259)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:396)
>         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
>         at org.apache.hadoop.mapred.Child.main(Child.java:253)
> Caused by: InvalidRequestException (*why:There is no ring for the keyspace: tmp*)
>         at org.apache.cassandra.thrift.Cassandra$describe_ring_result.read(Cassandra.java:24053)
>         at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:78)
>         at org.apache.cassandra.thrift.Cassandra$Client.recv_describe_ring(Cassandra.java:1065)
>         at org.apache.cassandra.thrift.Cassandra$Client.describe_ring(Cassandra.java:1052)
>         at org.apache.cassandra.hadoop.BulkRecordWriter$ExternalClient.init(BulkRecordWriter.java:225)
>         ... 12 more
> {code}
> After looking into the code I figured out that as we are setting the OUTPUTLOCATION with system property "java.io.tmpdir" the output directory is getting created as: /tmp/Keyspace_Name
> So in SSTableLoader while generating the kespace name like
> {code}
> this.keyspace = directory.getParentFile().getName();
> {code}
> It is setting the keyspace name as "tmp" and results into the above exception.
> I have changed the code as:
> {code}this.keyspace = directory.getName();{code}
> and it works perfect.
> But I am wondering how it was working fine previously? Am I doing anything wrong ? or is it a bug? 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira