cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Ellis (Resolved) (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (CASSANDRA-3698) Write sstables to HDFS and stream them to cassandar using Sstableloader.
Date Thu, 05 Jan 2012 13:47:39 GMT

     [ https://issues.apache.org/jira/browse/CASSANDRA-3698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jonathan Ellis resolved CASSANDRA-3698.
---------------------------------------

       Resolution: Won't Fix
    Fix Version/s:     (was: 1.1)

Just write them directly with BulkOutputFormat and skip the intermediate step.
                
> Write sstables to HDFS and stream them to cassandar using Sstableloader.
> ------------------------------------------------------------------------
>
>                 Key: CASSANDRA-3698
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-3698
>             Project: Cassandra
>          Issue Type: Improvement
>          Components: Tools
>            Reporter: Samarth Gahire
>              Labels: SSTableWriter, hadoop, hdfs, sstableloader
>   Original Estimate: 168h
>  Remaining Estimate: 168h
>
> As data size is growing very fast we are planning to create the sstables right from the
Hadoop reduce job.
> For that 
> 1) SSTableSimpleUnsortedWriter should be able to write sstables created to the HDFS .
> 2) Sstableloader utility should be able to read from HDFS to stream those sstables to
Cassandra

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message