[kepler-dev] [Bug 3274] New: - IPCC_Base_Layers.xml work-flow gets out of memeory error

[bugzilla-daemon at ecoinformatics.org]

http://bugzilla.ecoinformatics.org/show_bug.cgi?id=3274

           Summary: IPCC_Base_Layers.xml work-flow gets out of memeory error
           Product: Kepler
           Version: 1.0.0beta3
          Platform: Other
        OS/Version: All
            Status: NEW
          Severity: normal
          Priority: P2
         Component: data access
        AssignedTo: tao at nceas.ucsb.edu
        ReportedBy: tao at nceas.ucsb.edu
         QAContact: kepler-dev at ecoinformatics.org


When this work-flow tried to download 10 big data files, it can finish part of
downloading - maybe 6 and the rest 4 will keep busy. From log message, we can
find something like:
Exception in thread "Data ecogrid://knb/IPCC.200735416582829.1"
java.lang.OutOfMemoryError: Java heap space
Exception in thread "Data ecogrid://knb/IPCC.200735416192871.1"
java.lang.OutOfMemoryError: Java heap space
Exception in thread "Data ecogrid://knb/IPCC.200735417143125.1"
java.lang.OutOfMemoryError: Java heap space
Exception in thread "Data ecogrid://knb/IPCC.200735416271261.1"
java.lang.OutOfMemoryError: Java heap space

When I increase the heap size of Kepler to 1.2G (current value is 5M), the
downloading can be done without any problem.

I went to through the downloading code again, it seems to me we use input and
out stream, so not sure why it uses so many memory. 

If it is possible we can remove this work-flow from this release?