[kepler-users] dataflow using Kepler on Amazon EC2

[Jianwu Wang]

Hi Luqman,

     Your target is still not clear to me. Please break it into sub 
tasks so that we can help more efficiently. Or you can try Kepler first 
before getting more specific questions to ask.

     About Kepler workflow execution on EC2, I did some experiments on 
it and don't think it is hard to execute Kepler workflows on EC2.

Best wishes

Sincerely yours

Jianwu Wang
jianwu at sdsc.edu
http://users.sdsc.edu/~jianwu/

Assistant Project Scientist
Scientific Workflow Automation Technologies (SWAT) Laboratory
San Diego Supercomputer Center
University of California, San Diego
San Diego, CA, U.S.A.


On 3/21/2011 5:10 PM, Luqman Hodgkinson wrote:
>
>
>
> Dear Kepler developers,
> I have a collection of Java classes linked by a custom dataflow architecture. All classes are in a single project but some of these classes call executables written in languages other than Java. I am investigating the possibility of transitioning to Kepler. Essentially my desires are to link these Java classes in a DAG representing the dataflow and to execute the dataflow in Amazon EC2. The data flowing along the edges are arbitrary custom Java classes. Additionally it is important to cache intermediate results. The data is acquired from a few web services: iRefIndex, IntAct, UniProt, and Gene Ontology. There are complex software dependencies so after setting up the dataflow I would like to save the entire system as an abstract machine image (AMI). How difficult would this transition be, and would it be worth the effort? I would appreciate your comments and advice.
> 		Sincerely, with best wishes,
> 		Luqman Hodgkinson,
> 		Ph.D. student, UC-Berkeley
> _______________________________________________
> Kepler-users mailing list
> Kepler-users at kepler-project.org
> http://lists.nceas.ucsb.edu/kepler/mailman/listinfo/kepler-users