[seek-dev] Transfer huge data file in EcoGrid
bzhu at sdsc.edu
Fri Dec 17 11:12:36 PST 2004
It is not clear to me if we still require to install a grid-ftp server in
And also we need to have 'session ID' after we implemented authentication
From: seek-dev-admin at ecoinformatics.org
[mailto:seek-dev-admin at ecoinformatics.org]On Behalf Of Jing Tao
Sent: Thursday, December 16, 2004 2:41 PM
To: kepler-dev at nceas.ucsb.edu; seek-dev at ecoinformatics.org
Subject: [seek-dev] Transfer huge data file in EcoGrid
It seems we haven't found a way to stream big data object from EcoGrid
service to client machine directly.
Here is a hybrid approach which i am thinking to figure out this issue by
use grid ftp.
Hybrid means this approach will need both client lib and web service. The
main task will be taken in client side and web service will provide some
In client lib, we will created a method named "transfer" and it signature
public void transfer(String host, int port, String docId, DataSink sink)
This method will initialize a GridFTPClient object(using host and port)
and call a "extenedGet" method to get the remote file:
extendedGet(String remoteFileName, long size, DataSink sink)
In order to get remoteFileName and file size, we need two web services in
String getFilePath(String docid)
long getFileSize(String docid)
The above two web service method will be called in "transfer" method
before calling "extenedGet" in order to get remoteFileName and file size.
This approach is not a pure web service, client software(such as Kepler)
should stick the ecogrid client lib. In ecogrid service, we also need to
run a grid ftp server.
Any suggestion and comment will be appreciated.
National Center for Ecological
Analysis and Synthesis (NCEAS)
735 State St. Suite 204
Santa Barbara, CA 93101
seek-dev mailing list
seek-dev at ecoinformatics.org
More information about the Seek-dev