Hi Jianwu,<div><br>Thanks for your reply.</div><div><br></div><div>1) I am still contemplating whether installing Open SSH on the server would resolve the problem and will have to try this and let you know.</div><div><br></div>
<div>2) As the repository scales, I would have to use the power of Grid or something similar since its not just one simple excel file I would be working with.</div><div><br></div><div>3) Master- Slave option sounds interesting. But, do EcoGrid actors necessarily be involved in this?</div>
<div>I am aware that it uses the Distributed Composite Actor. Is there any example that I can look at so that I could configure my workflow accordingly and send it across?</div><div><br></div><div>Thanks!</div><div><br></div>
<div><br></div><div><br><div class="gmail_quote">On Sun, Oct 4, 2009 at 7:01 PM, Jianwu Wang <span dir="ltr"><<a href="mailto:jianwu@sdsc.edu">jianwu@sdsc.edu</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">
<div bgcolor="#ffffff" text="#000000">
Hi Subhav,<br>
<br>
One solution to use SSH on windows environment is to install SSH
server on the server.
<a href="http://www.rasyid.net/2007/05/18/install-ssh-server-in-windows-xp/" target="_blank">http://www.rasyid.net/2007/05/18/install-ssh-server-in-windows-xp/</a>,
<a href="http://www.topshareware.com/MobaSSH-download-59394.htm" target="_blank">http://www.topshareware.com/MobaSSH-download-59394.htm</a>.<br>
<br>
How do you modify/add content are for eg: Excel Files locally? <br>
<br>
It looks you do not need huge data transfer and powerful remote
computing resources. So I think Grid related actors do not fit your
requirements very well. <br>
<br>
Another solution is to use Kepler master-slave architecture
<a href="https://kepler-project.org/developers/incubation/distributed-ms" target="_blank">https://kepler-project.org/developers/incubation/distributed-ms</a>. If you
send me the local workflow for your purpose, I can try to help you
transform it using master-slave.<div><div></div><div class="h5"><br>
<pre cols="72">Best wishes
Sincerely yours
Jianwu Wang
<a href="mailto:jianwu@sdsc.edu" target="_blank">jianwu@sdsc.edu</a>
<a href="http://users.sdsc.edu/~jianwu/" target="_blank">http://users.sdsc.edu/~jianwu/</a>
Scientific Workflow Automation Technologies (SWAT) Laboratory
San Diego Supercomputer Center
University of California, San Diego
San Diego, CA, U.S.A. </pre>
<br>
<br>
subhav mital wrote:
<blockquote type="cite">Thanks Jianwu.
<div><br>
</div>
<div>I have tried and implemented the exact same scenario that you
are talking about. However, it does not serve my purpose completely,
because the files I need to be able to modify/add content are for eg:
Excel Files. Hence, the server (remote server) needs to be running on a
Windows environment. </div>
<div><br>
</div>
<div>(Moreover, the control of modifying them on the server needs to
be automated and initiated from the Client using Kepler. Though this
would be implemented once my primary concern gets resolved).</div>
<div><br>
</div>
<div>Since this is not possible using the SSH scenario that I tried
implementing, I thought the Grid would help in some way.</div>
<div><br>
</div>
<div>Can you think of any other alternative to get this done? How do
other projects collaboratively share/store files across multiple
servers? Also, I understand that the Data Grid File Transfer is not
working. So, which other Grid related File Support functionality can I
use, which can help me better accomplish the aforementioned scenario?</div>
<div><br>
</div>
<div>Thanks!</div>
<div><br>
</div>
<div><br>
<div><br>
<div class="gmail_quote">On Mon, Sep 28, 2009 at 2:29 AM, Jianwu Wang
<span dir="ltr"><<a href="mailto:jianwu@sdsc.edu" target="_blank">jianwu@sdsc.edu</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="border-left:1px solid rgb(204, 204, 204);margin:0pt 0pt 0pt 0.8ex;padding-left:1ex">
<div bgcolor="#ffffff" text="#000000">
Hi Subhav:<br>
<br>
There is a test workflow for Data Grid File Transfer actor at
<a href="https://code.kepler-project.org/code/kepler/trunk/workflows/srb/datagridtest.xml" target="_blank">https://code.kepler-project.org/code/kepler/trunk/workflows/srb/datagridtest.xml</a>.
Yet the server failed to response when I just test it. :(<br>
<br>
About the scenario, the possible workflows depend on many
conditions, such as the server/client operation system, the connection
protocols supported between server and clients, and which kind of
execution you want to execute on the server. Do you mean client or
server which has windows environment? The easiest workflow I can
imagine is using SSH File Copier (org.kepler.actor.ssh.FileCopier) or
SCP (org.geon.Scp) actor to copy file and use SSH to Execute
(org.kepler.actor.ssh.ExecuteCmd) or SSH Execute cmd
(org.sdm.spa.Ssh2Exec) actor to execute on the server. Please try. <br>
<br>
BTW: you do not need to send emails to both kepler-users and
kepler-dev, since most Kepler developers are in both mailing lists.
<div>
<div><br>
<pre cols="72">Best wishes
Sincerely yours
Jianwu Wang
<a href="mailto:jianwu@sdsc.edu" target="_blank">jianwu@sdsc.edu</a>
<a href="http://users.sdsc.edu/%7Ejianwu/" target="_blank">http://users.sdsc.edu/~jianwu/</a>
Scientific Workflow Automation Technologies (SWAT) Laboratory
San Diego Supercomputer Center
University of California, San Diego
San Diego, CA, U.S.A. </pre>
<br>
<br>
subhav mital wrote:
<blockquote type="cite">Thanks Jianwu.
<div>So how do I go about using the Data Grid File Transfer
actor?
<div><br>
<div>Do I need an SDSC account? Are there any sample workflows
which
I can see to understand and learn? (The Globus actors don't work and
the SRB actors require me to have an account)</div>
<div><br>
</div>
<div>My primary interest would be regarding the scenario
mentioned in
the User Manual in a Windows environment. These files may be excel
files, for eg, which are being transferred to the server, some
modifications being made there, and copied back to the client.</div>
<div><br>
</div>
<div>Just for reference, I am pasting the scenario again
mentioned in
the manual: <span style="font-family:arial,sans-serif;font-size:13px;border-collapse:collapse">"A
very common scenario is the following: a user needs to copy (or stage)
a set of files from one resource (e.g., the local environment) to a
remote resource, run a computational experiment on that remote</span></div>
<span style="font-family:arial,sans-serif;font-size:13px;border-collapse:collapse">
<div>resource, and then fetch the results back to the local
environment or copy them to another</div>
<div>resource/database."</div>
<div><br>
</div>
<div>...Including Kepler-Dev in the loop too..</div>
<div><br>
</div>
<div><span style="border-collapse:separate;font-family:arial;font-size:small">Thanks.</span></div>
</span>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div>
<div><br>
<div class="gmail_quote">On Sun, Sep 27, 2009 at 1:20 PM, Jianwu
Wang <span dir="ltr"><<a href="mailto:jianwu@sdsc.edu" target="_blank">jianwu@sdsc.edu</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="border-left:1px solid rgb(204, 204, 204);margin:0pt 0pt 0pt 0.8ex;padding-left:1ex">
<div bgcolor="#ffffff" text="#000000">Hi Matt,<br>
<br>
DICE group (<a href="http://diceresearch.org/DICE_Site/Home/Home.html" target="_blank">http://diceresearch.org/DICE_Site/Home/Home.html</a>)
has
iRODS service now. Yet the previous SRB service is still there. My
tests two months ago for SRB actors still work. For iRODS service, they
implemented a new actor called DataGridTransfer. I checked it in Kepler
1.x. It's url at kepler trunk is <a href="https://code.kepler-project.org/code/kepler/trunk/modules/actors/src/org/srb/DataGridTransfer.java" target="_blank">https://code.kepler-project.org/code/kepler/trunk/modules/actors/src/org/srb/DataGridTransfer.java</a>.
<br>
<br>
The DataGridFileTransfer actor has functionality similar to the
SRB/IRODS commands, namely Sget, Sput, iget, and iput.
DataGridFileTransfer allows users to copy one or more objects from one
local/remote file system to another local/remote file system. The
following actor expects as input a reference to local or remote file
systems support by the Jargon API . This reference connection is
created from the source and destination URL values, Currently available
file system URLs are, <a>file:///myDir/myfile.txt</a>,
<a href="mailto:irods://username:password@myhost.org:1247/myDir/myfile.txt" target="_blank">irods://username:password@myhost.org:1247/myDir/myfile.txt</a>,
<a href="mailto:srb://username.domain:password@myhost.org:5544/myDir/myfile.txt" target="_blank">srb://username.domain:password@myhost.org:5544/myDir/myfile.txt</a>,
or ftp
and http urls. <br>
<div><br>
<pre cols="72">Best wishes
Sincerely yours
Jianwu Wang
<a href="mailto:jianwu@sdsc.edu" target="_blank">jianwu@sdsc.edu</a>
<a href="http://users.sdsc.edu/%7Ejianwu/" target="_blank">http://users.sdsc.edu/~jianwu/</a>
Scientific Workflow Automation Technologies (SWAT) Laboratory
San Diego Supercomputer Center
University of California, San Diego
San Diego, CA, U.S.A. </pre>
<br>
<br>
</div>
<div>
<div>Matt Jones wrote:
<blockquote type="cite">I've learned that SDSC seems to be
migrating away from the
SRB and instead setting up a new iRODS service. Certainly that may
affect the accounts that people use, and it may also have implications
for whether the SRB actors continue to function properly -- I'm not
sure if the iRODS server uses the same API as the SRB server, so its
not clear to me if they will be backwards compatible. Ilkay -- do you
know who might be able to clarify compatibility plans with the new
service at SDSC?<br>
<br>
Matt<br>
<br>
<div class="gmail_quote">On Sat, Sep 26, 2009 at 8:55 PM,
subhav
mital <span dir="ltr"><<a href="mailto:mital.subhav@gmail.com" target="_blank">mital.subhav@gmail.com</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="border-left:1px solid rgb(204, 204, 204);margin:0pt 0pt 0pt 0.8ex;padding-left:1ex">Thanks
a lot, Jianwu. I was able to download these workflows but unable to run
them due to the certificate error I guess. I have emailed the admin and
am waiting for a reply to get my account set up.
<div><br>
</div>
<div>Thanks!!</div>
<div>
<div>
<div><br>
<br>
<div class="gmail_quote">On Sat, Sep 26, 2009 at 11:29 PM,
Jianwu
Wang <span dir="ltr"><<a href="mailto:jianwu@sdsc.edu" target="_blank">jianwu@sdsc.edu</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="border-left:1px solid rgb(204, 204, 204);margin:0pt 0pt 0pt 0.8ex;padding-left:1ex">
<div bgcolor="#ffffff" text="#000000">Hi Subhav,<br>
<br>
Please try the workflows at <a href="https://code.kepler-project.org/code/kepler/trunk/workflows/srb/" target="_blank">https://code.kepler-project.org/code/kepler/trunk/workflows/srb/</a>,
which
has test account for SRB. If you want to have your own account, you can
apply through SRB mailing list: <a href="mailto:srb@sdsc.edu" target="_blank">srb@sdsc.edu</a>.<br>
<pre cols="72">Best wishes
Sincerely yours
Jianwu Wang
<a href="mailto:jianwu@sdsc.edu" target="_blank">jianwu@sdsc.edu</a>
<a href="http://users.sdsc.edu/%7Ejianwu/" target="_blank">http://users.sdsc.edu/~jianwu/</a>
Scientific Workflow Automation Technologies (SWAT) Laboratory
San Diego Supercomputer Center
University of California, San Diego
San Diego, CA, U.S.A. </pre>
<br>
<br>
subhav mital wrote:
<blockquote type="cite">
<div>
<div>Hello,
<div><br>
</div>
<div>I was trying to use SRB actors and believe that I
need
to
set up
an account to get a certificate on the website?</div>
<div><br>
</div>
<div>So in this case, do we use the account already set
up
for
Kepler
Users since I do not have a data or compute allocation and wish to have
one to run </div>
<div>certain workflows...</div>
<div><br>
</div>
<div>Thanks.</div>
</div>
</div>
<pre><hr size="4" width="90%">
_______________________________________________
Kepler-dev mailing list
<a href="mailto:Kepler-dev@kepler-project.org" target="_blank">Kepler-dev@kepler-project.org</a>
<a href="http://mercury.nceas.ucsb.edu/kepler/mailman/listinfo/kepler-dev" target="_blank">http://mercury.nceas.ucsb.edu/kepler/mailman/listinfo/kepler-dev</a>
</pre>
</blockquote>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</div>
<br>
_______________________________________________<br>
Kepler-users mailing list<br>
<a href="mailto:Kepler-users@kepler-project.org" target="_blank">Kepler-users@kepler-project.org</a><br>
<a href="http://mercury.nceas.ucsb.edu/kepler/mailman/listinfo/kepler-users" target="_blank">http://mercury.nceas.ucsb.edu/kepler/mailman/listinfo/kepler-users</a><br>
<br>
</blockquote>
</div>
<br>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</blockquote>
</div></div></div>
</blockquote></div><br></div>