cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Ellis (JIRA)" <j...@apache.org>
Subject [jira] Commented: (CASSANDRA-342) hadoop integration
Date Fri, 05 Feb 2010 17:41:28 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12830188#action_12830188
] 

Jonathan Ellis commented on CASSANDRA-342:
------------------------------------------

replying to myself: 

> if you really need to run more than one hadoop jvm per machine

it looks like the minimum task jvms you can restrict hadoop to is two (one map, one reduce),
and i don't think there is a sane way to give them different classpaths.  so we need to add
some kind of kludge for this, short term.  (long term, i think running the tasktracker and
jobs inside the cassandra jvm still makes the most sense for us.)

> hadoop integration
> ------------------
>
>                 Key: CASSANDRA-342
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-342
>             Project: Cassandra
>          Issue Type: New Feature
>          Components: Core
>            Reporter: Jonathan Ellis
>            Assignee: Jonathan Ellis
>             Fix For: 0.6
>
>         Attachments: 0001-v3-CASSANDRA-342.-Set-up-for-the-hadoop-commits.patch, 0001-v4-add-basic-hadoop-support-one-split-per-node.txt,
0001-v5-add-basic-hadoop-support-one-split-per-node.txt, 0002-v3-CASSANDRA-342.-Working-hadoop-support.patch,
0002-v4-add-wordcount-hadoop-example.txt, 0002-v5-add-wordcount-hadoop-example.txt, 0003-v3-CASSANDRA-342.-Adding-the-WordCount-example.patch,
0003-v4-add-WordCountSetup-multiple-tests.txt, 0003-v5-make-predicate-configurable.txt, 0004-v5-sub-splits.txt,
0005-v5-jar-packaging.txt, 0006-prevent-multiple-client-initializations.txt
>
>
> Some discussion on -dev: http://mail-archives.apache.org/mod_mbox/incubator-cassandra-dev/200907.mbox/%3Cf5f3a6290907240123y22f065edp1649f7c5c1add491@mail.gmail.com%3E

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message