[kepler-users] Kepler: how to change default runner
Jianwu Wang
jianwu at sdsc.edu
Thu Oct 18 11:47:06 PDT 2012
Hi Himanshu,
I'm glad to know the multiple actors work for you know.
About workflow execution on PBS, you can run workflows without
PBS-specific actors like GenericJobLauncher. It means you have to take
care of job submission by yourself. What I normally do for it is that
write a job script file and use job submission command to submit the
script file to PBS. The main part in the job script file will be kepler
execution command line. You can find more about it at
https://kepler-project.org/developers/reference/executing-kepler-from-the-command-line.
You can first try the command locally.
Note that the display actors, such as 'Display' and 'Image
Display', normally won't display their content when running on a
computing node in a cluster. We implemented ' redirectgui' option in
Kepler. But it was not released in kepler 2.3. If you want to use it,
you have to use kepler trunk version.
Best wishes
Sincerely yours
Jianwu Wang, Ph.D.
jianwu at sdsc.edu
http://users.sdsc.edu/~jianwu/
Assistant Project Scientist
Scientific Workflow Automation Technologies (SWAT) Laboratory
San Diego Supercomputer Center
University of California, San Diego
San Diego, CA, U.S.A.
On 10/17/12 10:11 PM, Himanshu ............. wrote:
> Hi Jianwu,
>
> It is possible by editing the module.txt file. I am able to access my
> all newly added actors now :) Thanks for replying.
>
> Now back to my original question. If I execute a simple workflow ( PFA
> the snapshot of my helloworld workflow), it should run on PBS without
> using GenericJobLauncher or any other similar actor. Is it possible??
>
> Himanshu
>
> On Thu, Oct 18, 2012 at 12:38 AM, Himanshu .............
> <himanshu.king at gmail.com <mailto:himanshu.king at gmail.com>> wrote:
>
> Hi Jianwu,
>
> yes, I was referring the same tutorial link. As per your
> suggestion, one can add more than one actor in Kepler but they
> will be in same module. I didn't make myself clear last time, my
> apologies. What I really wanted to ask was, what if I have created
> more than one module-suite each having few actors. In this case,
> how should i start Kepler so that every new actors in different
> module-suites are available to me. Can it be done my editing the
> module.txt file?? If yes then please share one example, if possible.
> And, Thanks for replying.
>
> Himanshu
>
> On Wed, Oct 17, 2012 at 6:40 PM, Jianwu Wang <jianwu at sdsc.edu
> <mailto:jianwu at sdsc.edu>> wrote:
>
> Hi Himanshu,
>
> Are you referring the tutorial link
> https://kepler-project.org/developers/teams/build/documentation/developing-a-hello-world-actor-using-the-kepler-build-system-and-eclipse?
>
>
> You definitely can add more than one actor into Kepler.
> Just repeat Step 4 and adding the actors into the same module.
> You can check 'actors' module
> (https://code.kepler-project.org/code/kepler/trunk/modules/actors/)
> in Kepler which has many actors in one module.
>
> Best wishes
>
> Sincerely yours
>
> Jianwu Wang, Ph.D.
> jianwu at sdsc.edu <mailto:jianwu at sdsc.edu>
> http://users.sdsc.edu/~jianwu/ <http://users.sdsc.edu/%7Ejianwu/>
>
> Assistant Project Scientist
> Scientific Workflow Automation Technologies (SWAT) Laboratory
> San Diego Supercomputer Center
> University of California, San Diego
> San Diego, CA, U.S.A.
>
> On 10/16/12 9:41 PM, Himanshu ............. wrote:
>> Hi Jianwu,
>>
>> Thanks for your reply.
>> I want to ask something else. Using Kepler tutorial, I am
>> able to add new Java actor but it lets you add only one actor
>> at a time. I added two java actor through eclipse but at a
>> time only one actor is available to me. If I want to use the
>> other (added) actor I need to stop the Kepler and restart it
>> by following command.
>>
>> ant change-to -Dsuite=<other added actor>
>> ant run
>>
>> Right??? but then the previous actor is not available to me.
>> Is there any way so that after adding 3-4 actors if I start
>> Kepler, all newly added actors will be available???
>>
>> Thanks
>> Himanshu
>>
>> On Thu, Oct 11, 2012 at 1:25 PM, Jianwu Wang <jianwu at sdsc.edu
>> <mailto:jianwu at sdsc.edu>> wrote:
>>
>> Hi Himanshu,
>>
>> Can you explain your question more clear? What does
>> "job should go to PBS directly" mean? GenericJobLauncher
>> actor helps you to send jobs to PBS. By default, it
>> creates a unique dir at $HOME/.kepler-hpcc directory and
>> copies job file there before submitting it. Are you
>> talking about submitting jobs without this copying?
>>
>> Also I don't know what "the default runner part of
>> Kepler engine" refers to.
>>
>> Best wishes
>>
>> Sincerely yours
>>
>> Jianwu Wang, Ph.D.
>> jianwu at sdsc.edu <mailto:jianwu at sdsc.edu>
>> http://users.sdsc.edu/~jianwu/ <http://users.sdsc.edu/%7Ejianwu/>
>>
>> Assistant Project Scientist
>> Scientific Workflow Automation Technologies (SWAT) Laboratory
>> San Diego Supercomputer Center
>> University of California, San Diego
>> San Diego, CA, U.S.A.
>>
>> On 10/11/12 2:14 AM, Himanshu ............. wrote:
>>> Hi All,
>>>
>>> I have installed Kepler on a cluster and by using
>>> 'GenericJobLauncher' actor i was able to submit a job on
>>> PBS as well. But my problem is, I don't want to use
>>> GenericJobLauncher or any other actor. Whatever workflow
>>> I execute, job should go to PBS directly. So I want to
>>> change the default runner part of Kepler engine but i
>>> don't know how to do that. Any help would be appreciated.
>>>
>>> Thanks
>>> Himanshu
>>>
>>>
>>> _______________________________________________
>>> Kepler-users mailing list
>>> Kepler-users at kepler-project.org <mailto:Kepler-users at kepler-project.org>
>>> http://lists.nceas.ucsb.edu/kepler/mailman/listinfo/kepler-users
>>
>>
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.nceas.ucsb.edu/kepler/pipermail/kepler-users/attachments/20121018/3a30173c/attachment-0001.html>
More information about the Kepler-users
mailing list