[kepler-users] Automate workflows?

[Christopher Brooks]

Hi Muhammad,
This is an excellent question and something I've been meaning to try to 
answer in the Ptolemy II faq.

I just added something to the Ptolemy II faq about this:
http://ptolemy.eecs.berkeley.edu/ptolemyII/ptIIfaq.htm#parameterSweeps
says:
> *4.11 How do a do a parameter sweep?*
>     A Parameter Sweep is when a model is run a number of times with
>     different parameters to perhaps find an optimal solution. For
>     details, see
>     http://chess.eecs.berkeley.edu/ptexternal/wiki/Main/ParameterSweeps <http://chess.eecs.berkeley.edu/ptexternal/wiki/Main/ParameterSweeps#in_browser>.

http://chess.eecs.berkeley.edu/ptexternal/wiki/Main/ParameterSweeps
says:

>
>   Parameter Sweeps
>
> A Parameter Sweep is when a model is run a number of times with 
> different parameters to perhaps find an optimal solution.
>
> These two articles in Wikipedia might be of interest.
>
>   * Design of Experiments (DoE)
>     <https://en.wikipedia.org/wiki/Design_of_experiments> (Wikipedia)
>   * Monte Carlo Simulation
>     <https://en.wikipedia.org/wiki/Monte_carlo_simulation> (Wikipedia)
>
> One way to do optimization in Ptolemy II would be to do a parameter 
> sweep on a model by using the higher order component (HOC) actors such 
> as ModelReference.
>
> See the ModelReference actor:
>
>   * Docs:
>     http://sisyphus.eecs.berkeley.edu:8079/hudson/job/ptII/javadoc/ptolemy/actor/lib/hoc/ModelReference.html
>
>   * Demo: ptolemy/actor/lib/hoc/demo/ModelReference/ModelReference.xml
>
> and RunCompositeActor
>
>   * http://sisyphus.eecs.berkeley.edu:8079/hudson/job/ptII/javadoc/ptolemy/actor/lib/hoc/RunCompositeActor.html
>
>
> Tests:
>
>   * ptII/ptolemy/actor/lib/hoc/test/auto/DEInPNInRunCompositeActor.xml
>   * ptII/ptolemy/actor/lib/hoc/test/auto/RunCompositeActor.xml
>   * ptII/ptolemy/actor/lib/hoc/test/auto/RunCompositeActor2.xml
>   * ptII/ptolemy/actor/lib/hoc/test/auto/RunCompositeActor3.xml
>   * ptII/ptolemy/actor/lib/hoc/test/auto/RunCompositeActor4.xml
>
> It is also possible to use a state machine:
>
>   * $PTII/ptolemy/domains/modal/demo/MultipleRuns/MultipleRuns.xml
>
> Another way is to invoke the model multiple times from the command 
> line and pass in different command line arguments. Properly escaping a 
> string can be tricky.
>
>   * See
>     http://ptolemy.eecs.berkeley.edu/ptolemyII/ptIIfaq.htm#invoking%20Ptolemy%20II?
>
>
>
>     Ptolemy/Kepler papers that cover Parameter Sweeps
>
>   * Jianwu Wang, "Distributed Execution Architectures in Ptolemy II
>     <http://chess.eecs.berkeley.edu/pubs/806/>," 9th Biennial Ptolemy
>     Miniconference, February 16, 2011
>   * Jianwu Wang, Altintas, I., Hosseini, P.R., Barseghian, D., Crawl,
>     D., Berkley, C., Jones, M.B., "Accelerating Parameter Sweep
>     Workflows by Utilizing Ad-hoc Network Computing Resources: an
>     Ecological Example
>     <http://users.sdsc.edu/%7Ejianwu/JianwuWang_files/Accelerating%20Parameter%20Sweep%20Workflows%20by%20Utilizing%20Ad-hoc%20Network%20Computing%20Resources%20-%20an%20Ecological%20Example%20%28SWF%202009%29.pdf>,"
>     Services - I, 2009 World Conference on, 6-10 July 2009. DOI
>     <http://dx.doi.org/10.1109/SERVICES-I.2009.9>
>   * David Abramson, Blair Bethwaite, Colin Enticott, Slavisa Garic,
>     Tom Peachey, "Parameter Space Exploration Using Scientific
>     Workflows
>     <http://link.springer.com/chapter/10.1007%2F978-3-642-01970-8_11>," Computational
>     Science -- ICCS 2009, Lecture Notes in Computer Science Volume
>     5544, 2009, pp 104-113.
>
>
>     Ptolemy/Kepler Mailing List mentions of Parameter Sweeps
>
>   * Monte Carlo Simulation In BCVTB
>     <https://groups.google.com/forum/#%21msg/bcvtb/O0yofsqczOs/lNK1skgh5iQJ>
>     October, 2012.
>   * Re: [kepler-users] System Dynamics Actor?
>     <https://lists.eecs.berkeley.edu/sympa/arc/ptolemy-hackers/2008-01/msg00007.html>
>     Jan. 2008.
>

On 9/18/13 6:14 AM, Muhammad Usama wrote:
> Is there any way I can automate workflows? e.g. set the range of 
> results which are required and then the workflow executes in loop and 
> on each iterations some parameters are adjusted until the results meet 
> the defined criteria?
>
> Is there anyway I can do that in kepler? or is there any other system 
> where I can do that?
>
> -- 
> Muhammad Usama
> 2011-NUST-MS-CS-009
>
>
> _______________________________________________
> Kepler-users mailing list
> Kepler-users at kepler-project.org
> http://lists.nceas.ucsb.edu/kepler/mailman/listinfo/kepler-users


-- 
Christopher Brooks, PMP                       University of California
Academic Program Manager & Software Engineer  US Mail: 337 Cory Hall
CHESS/iCyPhy/Ptolemy/TerraSwarm               Berkeley, CA 94720-1774
cxh at eecs.berkeley.edu, 707.332.0670           (Office: 545Q Cory)

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.nceas.ucsb.edu/kepler/pipermail/kepler-users/attachments/20130918/fa6137e5/attachment.html>