[seek-dev] Re: enm pipeline
Deana Pennington
dpennington at lternet.edu
Tue Sep 14 12:25:36 PDT 2004
I can work on the data, but not until Sep 27. If I can figure out how
to do templates in EML, it should go pretty quickly.
I think you have forgotten the pipeline that converts the IPCC climate
data to gis layers.
Deana
Matt Jones wrote:
> Hi Deana,
>
> We had the conference call on the ENM pipeline in Kepler this morning.
> Its amazing how much stuff still remains to be done. Our notes from
> the call are on the SEEK web site, including a list of action items to
> get the ENM pipeline done:
>
> http://seek.ecoinformatics.org/Wiki.jsp?page=ENMPipelineConferenceCall14Sep2004
>
>
> One of the items was tenatively assigned to you -- if you're willing.
> We need someone to coordinate getting the environmental data layers
> into an EcoGrid node and documented with EML metadata. Then they will
> be pulled into the pipelines as needed.
>
> Interestingly, because the ENM pipleline will have so many runs
> (500,000) it will be important to be able to distribute the load -- so
> it looks like we might be doing some of this stuff on multiple
> machines. Its gonna be a tough challenge, espacially because data
> transfer for the environmental data layers will be a significant
> bottleneck. Ricardo estimates that one species (500 GARP runs) will
> take between 6-24 hours, dependging on which env layers are used. So,
> unless we distribute it, we're looking at 1000 days to run this thing,
> obviously unacceptable. So the tradeoff between distributing the
> computation and moving the data is not an easy one to make. But we'll
> try to work it out.
>
> Could you look over the notes and let me know what you think? Thanks,
>
> Matt
--
********
Deana D. Pennington, PhD
Long-term Ecological Research Network Office
UNM Biology Department
MSC03 2020
1 University of New Mexico
Albuquerque, NM 87131-0001
505-277-2595 (office)
505-249-2604 (cell)
505 277-2541 (fax)
More information about the Seek-dev
mailing list