[kepler-dev] Map-Reduce

Jianwu Wang jianwu at sdsc.edu
Tue Jun 21 13:50:58 PDT 2011


Hi Scott,

     The MapReduce was first implemented for Hadoop 0.20.0 and was 
updated MapReduce module to work with Hadoop 0.21. From svn log, the 
last version working with hadoop 0.20.0 should be 26264. So if you 
update your mapreduce module to this version, it should work with 0.20.203.

     Please keep in mind that this module is not well tested and hasn't 
been publicly released.  If you find any bugs, please let us know. Thanks.

Best wishes

Sincerely yours

Jianwu Wang
jianwu at sdsc.edu
http://users.sdsc.edu/~jianwu/

Assistant Project Scientist
Scientific Workflow Automation Technologies (SWAT) Laboratory
San Diego Supercomputer Center
University of California, San Diego
San Diego, CA, U.S.A.


On 6/21/2011 6:44 AM, Scott Zimmer wrote:
> We've been trying to integrate the Map-Reduce module and I've noticed 
> that it uses Hadoop 0.21.  We are targeting an operational environment 
> where we would like to be using Hadoop 0.20.203 instead of Hadoop 
> 0.21.  Is there some particular functionality in Hadoop 0.21 that is 
> needed or can I safely make changes to use 0.20.203 with the 
> map-reduce module?  I appreciate any advice that you have.
>
> Scott
>
> -- 
> Scott Zimmer
> Optensity, Inc.
> 512-299-7218
>
>
> _______________________________________________
> Kepler-dev mailing list
> Kepler-dev at kepler-project.org
> http://lists.nceas.ucsb.edu/kepler/mailman/listinfo/kepler-dev
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.nceas.ucsb.edu/kepler/pipermail/kepler-dev/attachments/20110621/9179de98/attachment.html>


More information about the Kepler-dev mailing list