[kepler-users] [kepler-dev] SRB account needed ?

Sat Oct 3 11:32:55 PDT 2009

Thanks Jianwu.
I have tried and implemented the exact same scenario that you are talking
about. However, it does not serve my purpose completely, because the files I
need to be able to modify/add content are for eg: Excel Files. Hence, the
server (remote server) needs to be running on a Windows environment.

(Moreover, the control of modifying them on the server needs to be automated
and initiated from the Client using Kepler. Though this would be implemented
once my primary concern gets resolved).

Since this is not possible using the SSH scenario that I tried implementing,
I thought the Grid would help in some way.

Can you think of any other alternative to get this done? How do other
projects collaboratively share/store files across multiple servers? Also, I
understand that the Data Grid File Transfer is not working. So, which other
Grid related File Support functionality can I use, which can help me better
accomplish the aforementioned scenario?

Thanks!

On Mon, Sep 28, 2009 at 2:29 AM, Jianwu Wang <jianwu at sdsc.edu> wrote:

>  Hi Subhav:
>
>     There is a test workflow for Data Grid File Transfer actor at
> https://code.kepler-project.org/code/kepler/trunk/workflows/srb/datagridtest.xml.
> Yet the server failed to response when I just test it. :(
>
>     About the scenario, the possible workflows depend on many conditions,
> such as the server/client operation system, the connection protocols
> supported between server and clients, and which kind of execution you want
> to execute on the server. Do you mean client or server which has windows
> environment? The easiest workflow I can imagine is using SSH File Copier
> (org.kepler.actor.ssh.FileCopier) or SCP (org.geon.Scp) actor to copy file
> and use SSH to Execute (org.kepler.actor.ssh.ExecuteCmd) or SSH Execute cmd
> (org.sdm.spa.Ssh2Exec) actor to execute on the server. Please try.
>
>     BTW: you do not need to send emails to both kepler-users and
> kepler-dev, since most Kepler developers are in both mailing lists.
>
> Best wishes
>
> Sincerely yours
>
> Jianwu Wangjianwu at sdsc.eduhttp://users.sdsc.edu/~jianwu/
>
> Scientific Workflow Automation Technologies (SWAT) Laboratory
> San Diego Supercomputer Center
> University of California, San Diego
> San Diego, CA, U.S.A.
>
>
>
> subhav mital wrote:
>
> Thanks Jianwu.  So how do I go about using the Data Grid File Transfer
> actor?
> Do I need an SDSC account? Are there any sample workflows which I can see
> to understand and learn? (The Globus actors don't work and the SRB actors
> require me to have an account)
>
>  My primary interest would be regarding the scenario mentioned in the User
> Manual in a Windows environment. These files may be excel files, for eg,
> which are being transferred to the server, some modifications being made
> there, and copied back to the client.
>
>  Just for reference, I am pasting the scenario again mentioned in the
> manual: "A very common scenario is the following: a user needs to copy (or
> stage) a set of files from one resource (e.g., the local environment) to a
> remote resource, run a computational experiment on that remote
>  resource, and then fetch the results back to the local environment or
> copy them to another
> resource/database."
>
>  ...Including Kepler-Dev in the loop too..
>
>  Thanks.
>
>
>
>
> On Sun, Sep 27, 2009 at 1:20 PM, Jianwu Wang <jianwu at sdsc.edu> wrote:
>
>>  Hi Matt,
>>
>>     DICE group (http://diceresearch.org/DICE_Site/Home/Home.html) has
>> iRODS service now. Yet the previous SRB service is still there. My tests two
>> months ago for SRB actors still work. For iRODS service, they implemented a
>> new actor called DataGridTransfer. I checked it in Kepler 1.x. It's url at
>> kepler trunk is
>> https://code.kepler-project.org/code/kepler/trunk/modules/actors/src/org/srb/DataGridTransfer.java.
>>
>>
>>     The DataGridFileTransfer actor has functionality similar to the
>> SRB/IRODS commands, namely Sget, Sput, iget, and iput. DataGridFileTransfer
>> allows users to copy one or more objects from one local/remote file system
>> to another local/remote file system. The following actor expects as input a
>> reference to local or remote file systems support by the Jargon API . This
>> reference connection is created from the source and destination URL values,
>> Currently available file system URLs are, file:///myDir/myfile.txt,
>> irods://username:password@myhost.org:1247/myDir/myfile.txt,
>> srb://username.domain:password@myhost.org:5544/myDir/myfile.txt, or ftp
>> and http urls.
>>
>> Best wishes
>>
>> Sincerely yours
>>
>> Jianwu Wangjianwu at sdsc.eduhttp://users.sdsc.edu/~jianwu/ <http://users.sdsc.edu/%7Ejianwu/>
>>
>> Scientific Workflow Automation Technologies (SWAT) Laboratory
>> San Diego Supercomputer Center
>> University of California, San Diego
>> San Diego, CA, U.S.A.
>>
>>
>>
>>  Matt Jones wrote:
>>
>> I've learned that SDSC seems to be migrating away from the SRB and instead
>> setting up a new iRODS service.  Certainly that may affect the accounts that
>> people use, and it may also have implications for whether the SRB actors
>> continue to function properly -- I'm not sure if the iRODS server uses the
>> same API as the SRB server, so its not clear to me if they will be backwards
>> compatible.  Ilkay -- do you know who might be able to clarify compatibility
>> plans with the new service at SDSC?
>>
>> Matt
>>
>> On Sat, Sep 26, 2009 at 8:55 PM, subhav mital <mital.subhav at gmail.com>wrote:
>>
>>> Thanks a lot, Jianwu. I was able to download these workflows but unable
>>> to run them due to the certificate error I guess. I have emailed the admin
>>> and am waiting for a reply to get my account set up.
>>>  Thanks!!
>>>
>>>
>>> On Sat, Sep 26, 2009 at 11:29 PM, Jianwu Wang <jianwu at sdsc.edu> wrote:
>>>
>>>> Hi Subhav,
>>>>
>>>>     Please try the workflows at
>>>> https://code.kepler-project.org/code/kepler/trunk/workflows/srb/, which
>>>> has test account for SRB. If you want to have your own account, you can
>>>> apply through SRB mailing list: srb at sdsc.edu.
>>>>
>>>> Best wishes
>>>>
>>>> Sincerely yours
>>>>
>>>> Jianwu Wangjianwu at sdsc.eduhttp://users.sdsc.edu/~jianwu/ <http://users.sdsc.edu/%7Ejianwu/>
>>>>
>>>> Scientific Workflow Automation Technologies (SWAT) Laboratory
>>>> San Diego Supercomputer Center
>>>> University of California, San Diego
>>>> San Diego, CA, U.S.A.
>>>>
>>>>
>>>>
>>>> subhav mital wrote:
>>>>
>>>>  Hello,
>>>>  I was trying to use SRB actors and believe that I need to set up an
>>>> account to get a certificate on the website?
>>>>
>>>>  So in this case, do we use the account already set up for Kepler Users
>>>> since I do not have a data or compute allocation and wish to have one to
>>>> run
>>>> certain workflows...
>>>>
>>>>  Thanks.
>>>>
>>>> ------------------------------
>>>>
>>>> _______________________________________________
>>>> Kepler-dev mailing listKepler-dev at kepler-project.orghttp://mercury.nceas.ucsb.edu/kepler/mailman/listinfo/kepler-dev
>>>>
>>>>
>>>
>>> _______________________________________________
>>> Kepler-users mailing list
>>> Kepler-users at kepler-project.org
>>> http://mercury.nceas.ucsb.edu/kepler/mailman/listinfo/kepler-users
>>>
>>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.nceas.ucsb.edu/kepler/pipermail/kepler-users/attachments/20091003/63da8d44/attachment.html>