[kepler-dev] Re: [seek-dev] Transfer big dataset through stream

[Jing Tao]

Hi, Gregor:

How are you? It is so kind that Von forward my email to you and the offer 
I can contact you directly.

I took a look at the cogkit website and found it is very helpful for us. 
The basic what we want to do is transfer big size file from a grid server 
to a client software. Currently we use byte array to handle the transfer. 
You know, if the file size is too big, the byte array will cause problem. 

In CoG Kits site, there is a java code example for file transfter. But it 
seemed we should run two gridftp servers(soruce and destination) to make 
the transfer work. But we don't want our client software will be 
distributed with a gridftp server. I am wondering if you may show me some 
examples how client software can programmatically use cog desktop(Or Grid 
desktop? I only see grid desktop in website) or grid shell to achieve our 
purpose.

Thanks a lot for the help!

Jing
 
On Mon, 8 Nov 2004, Von Welch wrote:

> Date: Mon, 8 Nov 2004 22:17:16 -0600
> From: Von Welch <vwelch at ncsa.uiuc.edu>
> To: Bertram Ludaescher <ludaesch at sdsc.edu>
> Cc: Jing Tao <tao at nceas.ucsb.edu>, rbutler at ncsa.uiuc.edu,
>      seek-dev at ecoinformatics.org, kepler-dev at ecoinformatics.org
> Subject: Re: [seek-dev] Transfer big dataset through stream
> 
> 
> Jing,
> 
>  In regards to option 1, I asked Gregor von Laszewski
> <gregor at mcs.anl.gov>, who is the lead behind the Java CoG. His
> response is that such a client is included in Java CoG Kit version 4
> (www.cogkit.org). Some details from Gregor are given below. He also
> offered that you can contact him directly to expedite getting more
> details.
> 
>  In regards to option 2, I have no knowledge of this feature being
> supported in GT4.
> 
> Von
> 
> --details from Gregor--
> 
> www.cogkit.org, Java CoG Kit version 4
> 
> this includes code that not only can handle
> gridftp, but also WebDAV, and scp.
> 
> It comes with a GUI that looks like a windows desktop.
> 
> all is written in Java.
> 
> the program is called cog-desktop
> 
> we also have a Grid shell that is written in 100% java that can take 
> commands in an interactive shell.
> 
> at this time we are currently implementing an ability to execute a 
> number of commands stored in a file.
> 
> 
> Bertram Ludaescher writes (14:50 November 8, 2004):
>  > 
>  > Jing: 
>  > 
>  > I'm crossposting to kepler-dev since this is also interesting for
>  > several folks there.
>  > 
>  > Bertram
>  > 
>  > >>>>> "JT" == Jing Tao <tao at nceas.ucsb.edu> writes:
>  > JT> 
>  > JT> Hi, Randy and Von:
>  > JT> It was very nice to talk with you in the seek meeting.
>  > JT> 
>  > JT> In that the afternoon, we discussed about to transfer a big dataset 
>  > JT> by stream rather than a byte array. But I still have issues about this. 
>  > JT> Would you mind helping us to figure it out?
>  > JT> 
>  > JT> I think we have two options to achive this. But we are not sure if globus 
>  > JT> 4 will support those options. 
>  > JT> 
>  > JT> Option 1. Using http binding rather than soap binding in gwsdl. Our 
>  > JT> question is if globus 4 support http binding?
>  > JT> 
>  > JT> Option 2. Using gridftp for transfering file from server to client. 
>  > JT> If we want to transfer file from server to client by gridftp through Java, 
>  > JT> We need to install gridftp server in both server side and client side. 
>  > JT> This make some difficuties to distribute client. So I am wondering if globus(or some 
>  > JT> another place) has a gridftp java library in jar and client can call the 
>  > JT> jar lib directly to transfer files(no gridftp server in client at all). 
>  > JT> 
>  > JT> Thanks in advance for the help!
>  > JT> 
>  > JT> Jing
>  > JT> 
>  > JT> 
>  > JT> 
>  > JT> -- 
>  > JT> Jing Tao
>  > JT> National Center for Ecological
>  > JT> Analysis and Synthesis (NCEAS)
>  > JT> 735 State St. Suite 204
>  > JT> Santa Barbara, CA 93101
>  > JT> 
>  > JT> _______________________________________________
>  > JT> seek-dev mailing list
>  > JT> seek-dev at ecoinformatics.org
>  > JT> http://www.ecoinformatics.org/mailman/listinfo/seek-dev
> 

-- 
Jing Tao
National Center for Ecological
Analysis and Synthesis (NCEAS)
735 State St. Suite 204
Santa Barbara, CA 93101