[kepler-dev] [Bug 5403] Improve the performance of the workflow archiving data from dataturbine to metacat

bugzilla-daemon at ecoinformatics.org bugzilla-daemon at ecoinformatics.org
Sat Aug 18 02:28:35 PDT 2012


http://bugzilla.ecoinformatics.org/show_bug.cgi?id=5403

--- Comment #7 from Derik Barseghian <barseghian at nceas.ucsb.edu> 2012-08-18 02:28:35 PDT ---
I got the EcogridWriter changes merged into trunk, finished at r30478.

After this I tried to swap in CreateDataSetsFromDataTurbine for CreateDataSets
in the existing archive workflow, but it's not that simple, offhand it seemed
like some non-trivial changes would have to be made to the workflow.

So then I tried to run Dan's version of the workflow attached to this bug (with
url parameters changed to my test DT, and dev2). I got some Kepler lockup
errors initially due to memory. Then I got some authentication errors. I found
the EcogridWriter username using dc=sdsc, so I changed to dc=ecoinformatics ,
but I still get authentication issues. The workflow proceeds til complete
despite the error, but I don't think it submits anything (each time, debug msgs
on console report dealing w/ the same number of data points). I then ran the
original workflow to make sure it wasn't a network/dev2 issue. That succeeded. 

I expect I'm missing making a simple config change to the workflow.
After that's done, the summary report composite should be adapted and merged
into this workflow, and any other changes Jing and I made since the fork as
well. Then some testing.

-- 
Configure bugmail: http://bugzilla.ecoinformatics.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA Contact for the bug.


More information about the Kepler-dev mailing list