<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; color: rgb(0, 0, 0); font-size: 14px; font-family: Calibri, sans-serif; ">
<div>Hello all, </div>
<div><br>
</div>
<div> I have been following the conversation, and since the subject opened up a bit I would also mention VisTrails.org. They do not call it parameter sweep, but in actuality that is what they do as well. Having said this VisTrails is out of the box geared
toward visualizations (primarily because of the built-in modules), however it is very extensible. I have looked at both Kepler and Vistrails. I am a java programmer and had to step in to python as I chose Vistrails over Kepler. I have no bias toward any
tool and continue to follow the advances of Kepler. Taverna was primarily web services oriented which did not fit our use case and target community. Bottom line is that no workflow tool is a 100% fit. While I was reticent about learning the "plugin" aspects
of any one tool due to time constraints, I found it the key to making it work. </div>
<div> Having said this what Kepler has that Vistrails does not is the concept of Directors. These, as best as I can tell, provide a variety of workflow "firing" models. If you depend on that you probably need to stick with Kepler. </div>
<div><br>
</div>
<div>Eduardo</div>
<div><br>
</div>
<span id="OLK_SRC_BODY_SECTION">
<div style="font-family:Calibri; font-size:11pt; text-align:left; color:black; BORDER-BOTTOM: medium none; BORDER-LEFT: medium none; PADDING-BOTTOM: 0in; PADDING-LEFT: 0in; PADDING-RIGHT: 0in; BORDER-TOP: #b5c4df 1pt solid; BORDER-RIGHT: medium none; PADDING-TOP: 3pt">
<span style="font-weight:bold">From: </span>Christopher Brooks <<a href="mailto:cxh@eecs.berkeley.edu">cxh@eecs.berkeley.edu</a>><br>
<span style="font-weight:bold">Date: </span>Thursday, September 19, 2013 10:12 AM<br>
<span style="font-weight:bold">To: </span>Muhammad Usama <<a href="mailto:11mscsmusama@seecs.edu.pk">11mscsmusama@seecs.edu.pk</a>><br>
<span style="font-weight:bold">Cc: </span>"<a href="mailto:kepler-users@kepler-project.org">kepler-users@kepler-project.org</a>" <<a href="mailto:kepler-users@kepler-project.org">kepler-users@kepler-project.org</a>><br>
<span style="font-weight:bold">Subject: </span>Re: [kepler-users] Automate workflows?<br>
</div>
<div><br>
</div>
<div>
<div bgcolor="#FFFFFF" text="#000000">
<div class="moz-cite-prefix">You mean there are workflow systems other than Kepler and Ptolemy? :-) I had no idea.<br>
<br>
Actually, I don't know of other systems for parameter sweeps, but I'm sure that they are out there. Simulink can probably do them. You could look at Taverna. The parameter sweeps page below lists
<a class="moz-txt-link-freetext" href="https://lists.eecs.berkeley.edu/sympa/arc/ptolemy-hackers/2008-01/msg00007.html">
https://lists.eecs.berkeley.edu/sympa/arc/ptolemy-hackers/2008-01/msg00007.html</a>, which discusses STELLA. See
<a class="moz-txt-link-freetext" href="http://ptolemy.eecs.berkeley.edu/mailing-lists/split/0605/Re:_Berkeley_Madonna_and_System_Dynamics12">
http://ptolemy.eecs.berkeley.edu/mailing-lists/split/0605/Re:_Berkeley_Madonna_and_System_Dynamics12</a> for a discussion about System Dynamics.<br>
<br>
_Christopher<br>
<br>
On 9/19/13 6:17 AM, Muhammad Usama wrote:<br>
</div>
<blockquote cite="mid:CAMgTkN4Cqjsw1gUz-yi+BK=9FTbiHGidyrRuvszcNij3Q0=_sw@mail.gmail.com" type="cite">
<div dir="ltr">Thank you for reply. Parameter Sweeps is a new word for me. I didn't find this word while looking for a way to automate wokflows. But now I do and now I am reading about Parameter Sweeps.
<br>
<br>
Other than Kepler, do you know any other workflow system which can do parameter sweeps until the required results are found?<br>
</div>
<div class="gmail_extra"><br>
<br>
<div class="gmail_quote">On Wed, Sep 18, 2013 at 10:18 PM, Christopher Brooks <span dir="ltr">
<<a moz-do-not-send="true" href="mailto:cxh@eecs.berkeley.edu" target="_blank">cxh@eecs.berkeley.edu</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
<div>Hi Muhammad,<br>
This is an excellent question and something I've been meaning to try to answer in the Ptolemy II faq.<br>
<br>
I just added something to the Ptolemy II faq about this:<br>
<a moz-do-not-send="true" href="http://ptolemy.eecs.berkeley.edu/ptolemyII/ptIIfaq.htm#parameterSweeps" target="_blank">http://ptolemy.eecs.berkeley.edu/ptolemyII/ptIIfaq.htm#parameterSweeps</a><br>
says:<br>
<blockquote type="cite"><dt><a moz-do-not-send="true" name="14132145bfdec815_parameterSweeps"><b>4.11 How do a do a parameter sweep?</b></a></dt><dd>A Parameter Sweep is when a model is run a number of times with different parameters to perhaps find an optimal solution. For details, see
<a moz-do-not-send="true" href="http://chess.eecs.berkeley.edu/ptexternal/wiki/Main/ParameterSweeps#in_browser" target="_blank">
http://chess.eecs.berkeley.edu/ptexternal/wiki/Main/ParameterSweeps</a>. </dd></blockquote>
<a moz-do-not-send="true" href="http://chess.eecs.berkeley.edu/ptexternal/wiki/Main/ParameterSweeps" target="_blank">http://chess.eecs.berkeley.edu/ptexternal/wiki/Main/ParameterSweeps</a><br>
says:<br>
<br>
<blockquote type="cite">
<h1>Parameter Sweeps </h1>
<div></div>
<div>
<p>A Parameter Sweep is when a model is run a number of times with different parameters to perhaps find an optimal solution.
</p>
<p>These two articles in Wikipedia might be of interest. </p>
<ul>
<li><a moz-do-not-send="true" href="https://en.wikipedia.org/wiki/Design_of_experiments" rel="nofollow" target="_blank">Design of Experiments (DoE)</a> (Wikipedia)
</li><li><a moz-do-not-send="true" href="https://en.wikipedia.org/wiki/Monte_carlo_simulation" rel="nofollow" target="_blank">Monte Carlo Simulation</a> (Wikipedia)
</li></ul>
<p>One way to do optimization in Ptolemy II would be to do a parameter sweep on a model by using the higher order component (HOC) actors such as ModelReference.
</p>
<p>See the ModelReference actor: </p>
<ul>
<li>Docs: <a moz-do-not-send="true" href="http://sisyphus.eecs.berkeley.edu:8079/hudson/job/ptII/javadoc/ptolemy/actor/lib/hoc/ModelReference.html" rel="nofollow" target="_blank">
http://sisyphus.eecs.berkeley.edu:8079/hudson/job/ptII/javadoc/ptolemy/actor/lib/hoc/ModelReference.html</a></li><li>Demo: ptolemy/actor/lib/hoc/demo/ModelReference/ModelReference.xml </li></ul>
<p>and RunCompositeActor </p>
<ul>
<li><a moz-do-not-send="true" href="http://sisyphus.eecs.berkeley.edu:8079/hudson/job/ptII/javadoc/ptolemy/actor/lib/hoc/RunCompositeActor.html" rel="nofollow" target="_blank">http://sisyphus.eecs.berkeley.edu:8079/hudson/job/ptII/javadoc/ptolemy/actor/lib/hoc/RunCompositeActor.html</a></li></ul>
<p>Tests: </p>
<ul>
<li>ptII/ptolemy/actor/lib/hoc/test/auto/DEInPNInRunCompositeActor.xml </li><li>ptII/ptolemy/actor/lib/hoc/test/auto/RunCompositeActor.xml </li><li>ptII/ptolemy/actor/lib/hoc/test/auto/RunCompositeActor2.xml </li><li>ptII/ptolemy/actor/lib/hoc/test/auto/RunCompositeActor3.xml </li><li>ptII/ptolemy/actor/lib/hoc/test/auto/RunCompositeActor4.xml </li></ul>
<p>It is also possible to use a state machine: </p>
<ul>
<li>$PTII/ptolemy/domains/modal/demo/MultipleRuns/MultipleRuns.xml </li></ul>
<p>Another way is to invoke the model multiple times from the command line and pass in different command line arguments. Properly escaping a string can be tricky.
</p>
<ul>
<li>See <a moz-do-not-send="true" href="http://ptolemy.eecs.berkeley.edu/ptolemyII/ptIIfaq.htm#invoking%20Ptolemy%20II" rel="nofollow" target="_blank">
http://ptolemy.eecs.berkeley.edu/ptolemyII/ptIIfaq.htm#invoking%20Ptolemy%20II</a>?
</li></ul>
<h2>Ptolemy/Kepler papers that cover Parameter Sweeps</h2>
<ul>
<li>Jianwu Wang, "<a moz-do-not-send="true" href="http://chess.eecs.berkeley.edu/pubs/806/" rel="nofollow" target="_blank">Distributed Execution Architectures in Ptolemy II</a>," 9th Biennial Ptolemy Miniconference, February 16, 2011
</li><li>Jianwu Wang, Altintas, I., Hosseini, P.R., Barseghian, D., Crawl, D., Berkley, C., Jones, M.B., "<a moz-do-not-send="true" href="http://users.sdsc.edu/%7Ejianwu/JianwuWang_files/Accelerating%20Parameter%20Sweep%20Workflows%20by%20Utilizing%20Ad-hoc%20Network%20Computing%20Resources%20-%20an%20Ecological%20Example%20%28SWF%202009%29.pdf" rel="nofollow" target="_blank">Accelerating
Parameter Sweep Workflows by Utilizing Ad-hoc Network Computing Resources: an Ecological Example</a>," Services - I, 2009 World Conference on, 6-10 July 2009.
<a moz-do-not-send="true" href="http://dx.doi.org/10.1109/SERVICES-I.2009.9" rel="nofollow" target="_blank">
DOI</a> </li><li>David Abramson, Blair Bethwaite, Colin Enticott, Slavisa Garic, Tom Peachey, "<a moz-do-not-send="true" href="http://link.springer.com/chapter/10.1007%2F978-3-642-01970-8_11" rel="nofollow" target="_blank">Parameter Space Exploration Using Scientific Workflows</a>,"
Computational Science – ICCS 2009, Lecture Notes in Computer Science Volume 5544, 2009, pp 104-113.
</li></ul>
<h2>Ptolemy/Kepler Mailing List mentions of Parameter Sweeps</h2>
<ul>
<li><a moz-do-not-send="true" href="https://groups.google.com/forum/#%21msg/bcvtb/O0yofsqczOs/lNK1skgh5iQJ" rel="nofollow" target="_blank">Monte Carlo Simulation In BCVTB</a> October, 2012.
</li><li><a moz-do-not-send="true" href="https://lists.eecs.berkeley.edu/sympa/arc/ptolemy-hackers/2008-01/msg00007.html" rel="nofollow" target="_blank">Re: [kepler-users] System Dynamics Actor?</a> Jan. 2008.
</li></ul>
</div>
</blockquote>
<div>
<div class="h5"><br>
On 9/18/13 6:14 AM, Muhammad Usama wrote:<br>
</div>
</div>
</div>
<blockquote type="cite">
<div>
<div class="h5">
<div dir="ltr">
<div>Is there any way I can automate workflows? e.g. set the range of results which are required and then the workflow executes in loop and on each iterations some parameters are adjusted until the results meet the defined criteria?<br>
<br>
</div>
Is there anyway I can do that in kepler? or is there any other system where I can do that?<br clear="all">
<div>
<div><br>
-- <br>
<div>Muhammad Usama</div>
<div>2011-NUST-MS-CS-009</div>
</div>
</div>
</div>
<br>
<fieldset></fieldset> <br>
</div>
</div>
<pre>_______________________________________________
Kepler-users mailing list
<a moz-do-not-send="true" href="mailto:Kepler-users@kepler-project.org" target="_blank">Kepler-users@kepler-project.org</a><a moz-do-not-send="true" href="http://lists.nceas.ucsb.edu/kepler/mailman/listinfo/kepler-users" target="_blank">http://lists.nceas.ucsb.edu/kepler/mailman/listinfo/kepler-users</a><span class="HOEnZb"><font color="#888888"></font></span></pre>
<span class="HOEnZb"><font color="#888888"></font></span></blockquote>
<span class="HOEnZb"><font color="#888888"><br>
<br>
<pre cols="72">--
Christopher Brooks, PMP University of California
Academic Program Manager & Software Engineer US Mail: 337 Cory Hall
CHESS/iCyPhy/Ptolemy/TerraSwarm Berkeley, CA 94720-1774
<a moz-do-not-send="true" href="mailto:cxh@eecs.berkeley.edu" target="_blank">cxh@eecs.berkeley.edu</a>, <a moz-do-not-send="true" href="tel:707.332.0670" value="+17073320670" target="_blank">707.332.0670</a> (Office: 545Q Cory)
</pre>
</font></span></div>
</blockquote>
</div>
<br>
<br clear="all">
<br>
-- <br>
<div>Muhammad Usama</div>
<div>2011-NUST-MS-CS-009</div>
</div>
</blockquote>
<br>
<br>
<pre class="moz-signature" cols="72">--
Christopher Brooks, PMP University of California
Academic Program Manager & Software Engineer US Mail: 337 Cory Hall
CHESS/iCyPhy/Ptolemy/TerraSwarm Berkeley, CA 94720-1774
<a class="moz-txt-link-abbreviated" href="mailto:cxh@eecs.berkeley.edu">cxh@eecs.berkeley.edu</a>, 707.332.0670 (Office: 545Q Cory)
</pre>
</div>
</div>
</span>
</body>
</html>