systemml-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Luciano Resende <>
Subject Re: SystemML Hadoop version support
Date Wed, 20 Jan 2016 21:13:55 GMT
On Wed, Jan 20, 2016 at 12:50 PM, Deron Eriksson <>

> Does SystemML still support Hadoop 1?
> I see in MRConfigurationNames a static initialization block for Hadoop
> v1/v2 properties. I'd like to remove the current deprecated property
> warnings (log messages in the console) that we get with Hadoop v2.4.1 and I
> was wondering if I should add the old v1 and new v2 versions to
> MRConfigurationNames or if I can just add the new v2 versions and the v1
> versions can be removed.
> If we still support Hadoop v1, we might want to update the pom with
> profiles for Hadoop 1 and 2.
> Deron

Even Spark is moving away of supporting some old versions of Hadoop, etc...

I would really like us to be moving kind of together with other
dependencies, in the sense of supporting Hadoop 2.6 and up, and Spark 1.6
and maybe 1.5.2 as well.

Luciano Resende

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message