accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] [accumulo] milleruntime edited a comment on issue #1035: Improve DistributedCacheHelper. Closes #896
Date Mon, 18 Mar 2019 19:50:55 GMT
milleruntime edited a comment on issue #1035: Improve DistributedCacheHelper. Closes #896
URL: https://github.com/apache/accumulo/pull/1035#issuecomment-474074059
 
 
   > > Also, maybe we should consider not supporting the older mapred code since this
is one case where you have to use the mapreduce methods if you don't want to use deprecated.
   > 
   > This would make it hard to support the file-based token passing. We could just pull
the file directly from HDFS, in that case. However, I'm not sure it's true that it requires
the new API. I thought the old `JobConf` class does extend the internal `JobContext` which
has the method for retrieving the local cache files.
   
   AFAIK there are two different ways to use the cache:
   - For mapred: `DistributedCache.addCacheFile()`.  The older `JobConf` object extends `Configuration`.
   - For mapreduce: `Job.getInstance().addCacheFile()`  The newer `Job` class implements `org.apache.hadoop.mapreduce.JobContext`
   
   And this is the best documentation I have found: https://stackoverflow.com/questions/21239722/hadoop-distributedcache-is-deprecated-what-is-the-preferred-api
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

Mime
View raw message