[seek-dev] RE: OGSA version grid-ftp

Bing Zhu bzhu at sdsc.edu
Mon Nov 10 10:29:20 PST 2003


Jing,

It is great that we just need to modify the RTF code to implement our GET.

In this approach, our GET is an extension for the current RTF, meaning
that our GET actually supports the following protocols.
- ecogrid:
- grid-ftp
- http
- ftp

(The implementation for grid-ftp, http and ftp is a gift from RTF.)
So the ecogrid users have a flexibility to get data within eocgrid or
from any file system.

Sincerely,
Bing



-----Original Message-----
From: seek-dev-admin at ecoinformatics.org
[mailto:seek-dev-admin at ecoinformatics.org]On Behalf Of Jing Tao
Sent: Thursday, November 06, 2003 7:10 PM
To: Bing Zhu
Cc: Matt Jones; seek-dev at ecoinformatics.org
Subject: [seek-dev] RE: OGSA version grid-ftp


Hi, Bing:

Thanks for the suggestion and info. I am looking at RFT and it is an
OGSA based service that provides interfaces for controlling and monitoring
3rd party file transfers using GridFTP server. Basically, client pass a
src and des gridftp url, then the grid service will control the file
transfer.

I already install the grid service (RFT) in my local machine and
successfully transfer file from my local gridftp server  to my local
gridftp sever :). I tried to transfer form my local machine to dev and got
some
errors.

I am thinking we can modified the RFT code to achieve our GET method(I
already foud source code). I think there are two parameters will be pass
to GET, one is the document identifier and the other is destination url
(either a gridftp url or file url). Then GET method will do the two steps as
you
described(first get the source for Metacat or SRB, then call gridftp JAVA
API to send it). A integer will be returned from GET indicates if the ftp
transfer
successes or fails.

The issue I am think is about certicification. Probably it will take some
time to figure out.

Thanks.

Jing

On Wed, 5 Nov 2003, Bing Zhu wrote:

> Matt and Jing,
>
> Currently the OGSA version of grid-ftp is not available according to
> William(Bill) Allcock's
> mail below.
>
> Here is what I suggest for our GET.
>
> If the Java package for grid-ftp as you pointed in the web page
> http://www-unix.globus.org/cog/jftp/guide.html
> work, we can implement our GET file JAVA client with following steps.
>
> 1. GET contacts our Ecogrid system with a Ecogrid object ID and the grid
> service
>     returns actual host name along with physical path. (This is a OGSA
> service call.)
> 2. GET then call Java grid-ftp APIs to contact the grid-ftp server in that
> host to get
>     the file transferred.
>
> Since Metacat store files as links, this approach should work well with
> Metacat.
>
> For the SRB system, if files are actually stored inside SRB, streaming
data
> of files into grid-ftp server can be a pain.
> The grid-ftp driver I developed is another way around, i.e. SRB is on top
of
> grid-ftp. But I don't worry about this.
> SRB has other data model of using file registration in which files resides
> in their own place(s) and SRB just have links
> pointing to them. This is exactly the same as the implementation in
Metacat.
> So I didn't see any problem here.
>
> Bing
>
>
>
> -----Original Message-----
> From: William E. Allcock [mailto:allcock at mcs.anl.gov]
> Sent: Wednesday, November 05, 2003 6:11 PM
> To: bzhu at sdsc.edu
> Subject: RE: OGSA version grid-ftp
>
>
> The only thing we have right now, is the Reliable File Transfer Service
> (RFT)
>
> http://www-unix.globus.org/toolkit/reliable_transfer.html
>
> The rest of the OGSI-ification of GridFTP is VERY up in the air right now.
> The ideas around this work are mostly being discussed in the GGF Data
Access
> and Integration WG.  This will be a major thrust for next year, but right
> now
> I can't really tell you what it will look like, or when we will deliver
it.
>
> Bill
>
> >-----Original Message-----
> >From: Bing Zhu [mailto:bzhu at sdsc.edu]
> >Sent: Tuesday, November 04, 2003 17:20
> >To: William E. Allcock
> >Subject: OGSA version grid-ftp
> >
> >
> >Bill,
> >
> >This is Bing again. This time I am sending the mail as a developer from
the
> >the Science Environment for Ecological Knowledge (SEEK) project.
> >
> >We are interested in an OGSA version (or wrappers) grid-ftp. I heard in
> >GlobusWorld 2003
> >in San Diego that your team had been working on this. Would you provide
me
> >some updates
> >or some web links so that I can do an evaluation for the SEEK project? We
> >are also interested
> >OGSA-version grid-ftp APIs. Thanks.
> >
> >Sincerely,
> >Bing
> >===============================================================
> >Bing Zhu
> >Programmer/Analyst III
> >Data and Knowledge Systems
> >San Diego Supercomputer Center
> >(858)534-8373
> >bzhu at sdsc.edu
> >===============================================================
> >
>

--
Jing Tao
National Center for Ecological
Analysis and Synthesis (NCEAS)
735 State St. Suite 204
Santa Barbara, CA 93101

_______________________________________________
seek-dev mailing list
seek-dev at ecoinformatics.org
http://www.ecoinformatics.org/mailman/listinfo/seek-dev




More information about the Seek-dev mailing list