[kepler-users] Distributed algorithm

[Jianwu Wang]

Hi Madhavi,

     You want the workflow kar file to be executed on one node of PBS or 
schedule actors among multiple nodes of PBS?

     The current job submission support in Kepler is mainly for 
submitting separate executables to a cluster, not a workflow. Yet I 
think it will also work to use kepler.sh as executable to execute your 
workflow on one node of PBS. But you need install Kepler on your cluster 
first. I don't know there are simpler ways.

     If you want to schedule actors among multiple nodes of PBS, you can 
try Kepler master-slave module 
(https://kepler-project.org/developers/incubation/distributed-ms) in 
Kepler. You need add either module master-slave-2.0 
(https://code.kepler-project.org/code/kepler/releases/release-branches/master-slave-2.0/) 
or module master-slave in trunk 
(https://code.kepler-project.org/code/kepler/trunk/modules/master-slave/) into 
your suite. Then you need to wrap your actors to-be-distributed in 
DistributedCompositeActor in master-slave module. You also need start 
slave started on each PBS node so that this node can accept sub-workflow 
input from master.

Best wishes

Sincerely yours

Jianwu Wang
jianwu at sdsc.edu
http://users.sdsc.edu/~jianwu/

Assistant Project Scientist
Scientific Workflow Automation Technologies (SWAT) Laboratory
San Diego Supercomputer Center
University of California, San Diego
San Diego, CA, U.S.A.


On 1/28/2011 4:14 AM, Madhavi Tikhe wrote:
>
> Hi,
>
> I need to run a workflow in distributed environment.
>
> I have following things in place for me
>
> -Linux cluster
>
> -PBS
>
> -Couple of actors written
>
> -A workflow kar file created using those actors.
>
> I want my workflow to run over the cluster sending jobs to pbs.
>
> Is this possible in Kepler? Is there a way to flag a actor to run on 
> cluster distributing jobs using PBS?
>
> Kepler User Manual has a workflow that creates jobs. But I found it 
> complicated. Is there a simple solution?
>
> Thanks,
> madhavi
>
> DISCLAIMER ========== This e-mail may contain privileged and 
> confidential information which is the property of Persistent Systems 
> Ltd. It is intended only for the use of the individual or entity to 
> which it is addressed. If you are not the intended recipient, you are 
> not authorized to read, retain, copy, print, distribute or use this 
> message. If you have received this communication in error, please 
> notify the sender and delete all copies of this message. Persistent 
> Systems Ltd. does not accept any liability for virus infected mails.
>
>
> _______________________________________________
> Kepler-users mailing list
> Kepler-users at kepler-project.org
> http://lists.nceas.ucsb.edu/kepler/mailman/listinfo/kepler-users
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.nceas.ucsb.edu/kepler/pipermail/kepler-users/attachments/20110128/51ba8bb2/attachment.html>