[kepler-users] Hard-coded limit to number of threads in OSX (Mountain Lion)?

[Charles Cowart]

Hi Jon,

It appears that, at least for MacOSX 10.8 desktop version, the number of threads allowed per process (sysctl kern.num_taskthreads) is set permanently at 2048 for both root and standard users; the server edition may be different, however.

Can you elaborate on what is causing the workflow to use upwards of 4000 threads? Perhaps we can be of help there.

Best regards,

Charles
---
Charles Cowart
Workflow Specialist
Scientific Workflow Automation Technologies (SWAT) Laboratory
San Diego Supercomputer Center
University of California, San Diego
San Diego, CA, U.S.A.


On Jul 26, 2013, at 3:36 PM, Jonathan Boright <boright at isciences.com> wrote:

> Hi All,
> 
> Just a quick note to see if anyone has found a work-around for an
> issue that we have recently stumbled upon.
> 
> We are in the process of migrating some work flows originally built
> using Cygwin  (Windows machines) to OSX (Mac Mini running Mountain
> Lion). Apparently there is a limit to the number of threads allowed
> for a single process on all OSX. In previous versions of OSX this
> limit was flexible (and depended somewhat on RAM) , but on Mountain
> Lion it is hard-coded to 2048 (or something in that neighborhood).
> Because some of our workflows use upwards of 4000 threads, this
> presents a problem for us. Our current work-around is to break our
> large workflows into smaller ones... but if anybody has any relevant
> knowledge or experience dealing with this... we'd love to hear about
> it!
> 
> Thanks in advance.
> 
> Jon
> 
> -- 
> ---------------------------------
> Jonathan Boright
> Research Scientist
> ISciences, LLC
> 61 Main Street, Suite 200
> Burlington, VT 05401
> _______________________________________________
> Kepler-users mailing list
> Kepler-users at kepler-project.org
> http://lists.nceas.ucsb.edu/kepler/mailman/listinfo/kepler-users